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Abstract 

This  thesis  examined  eost  growth  in  Department  of  Defense  (DoD)  missile 
systems  from  1991  to  2001  using  Seleeted  Aequisition  Report  (SAR)  data  with  a  hybrid 
adjusted  eost  growth  (ACG)  model.  In  addition,  an  analysis  of  aequisition  reform 
initiatives  during  the  treatment  period  was  eondueted  to  determine  if  reform  efforts 
impaeted  missile  system  eost  growth.  A  “pre-reform”  (1  January  1991  to  31  Deeember 
1996)  period  and  “post  reform”  (1  January  1997  to  31  Deeember  2001)  period  was 
subjeetively  developed  to  eompare  the  mean  annual  ACG  during  eaeh  period  for 
statistieal  differenees.  The  hybrid  ACG  model  outlined  in  this  thesis  may  aid  program 
managers  and  other  interested  parties  in  determining  weapon  systems  eost  growth,  and 
the  eonelusion  drawn  from  analyzing  eurrent  aequisition  initiatives  may  aid  DoD 
leadership  in  assessing  reform  effeetiveness  on  redueing  eost  growth. 

This  researeh  effort  analyzed  135  SARs  for  21  missile  systems  that  reported  a 
Milestone  II  baseline  during  the  treatment  period.  ACG  ealeulations  revealed  that  missile 
systems  from  1  January  1991  to  31  Deeember  2001  averaged  28  pereent  eost  growth 
annually.  The  aequisition  reform  analysis  ineluded  76  SARs  from  20  programs  during 
the  pre-reform  period  and  59  SARs  from  13  programs  in  the  post-reform  period.  A  small 
sample  t-test  and  a  signifieanee  level  of  0.05  were  used  to  eompare  the  annual  means  of 
the  two  periods.  The  analysis  revealed  that  the  annual  average  ACG  of  the  post  reform 
period  is  signifieantly  higher  than  the  annual  average  ACG  of  the  pre-reform  period.  The 
thesis  methodology,  results,  and  suggestions  for  future  researeh  are  provided. 
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AN  ANALYSIS  OF  MISSILE  SYSTEMS  COST  GROWTH  AND 


IMPLEMENTATION  OF  ACQUISITION  REFORM  INITIATIVES  USING  A 
HYBRID  ADJUSTED  COST  GROWTH  MODEL 


I.  Introduction 


General  Issue 

Cost  growth  in  major  weapon  system  programs,  defined  as  the  difference  between 
estimated  and  actual  costs,  has  been  an  enduring  problem  in  the  Department  of  Defense 
(DoD)  for  the  past  four  decades.  According  to  a  1993  RAND  study,  cost  growth  has 
hovered  around  20  percent  since  the  mid  1960s  (Drezner  et  al,  1993:xiii).  Table  1 
identifies  the  average  cost  growth  factors  between  services  as  of  31  December  1990  and 
Table  2  provides  the  average  cost  growth  factors  by  system  type  as  of  31  December  1990. 


Table  1,  Cost  Growth  Differences  Between  Services  (Drezner,  1993:26) 


Service 

Cost 

Growth 

Factor 

Number  of 
Observations 

Average  Program 
Cost  (billions 
FY90$) 

Average  Age  (years 
past  EMD) 

Total  DE 

1.20 

120 

5.50 

9.40 

Air  Force 

1.20 

41 

6.70 

8.70 

Army 

1.35 

28 

2.70 

10.30 

Navy 

1.16 

51 

6.10 

9.50 

NOTE:  DE  baseline,  weighted  average,  mature  programs. 
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Table  2,  Cost  Growth  by  System  Type  (Drezner,  1993:28) 


Weapon 

Type 

Cost 

Growth 

Factor 

Number  of 
Observations 

Average  Program 
Cost  (billions 
Fy90$) 

Average  Age  (years 
past  EMD) 

Aircraft 

1.28 

14 

13.80 

10.50 

Helicopter 

1.13 

5 

8.10 

13.00 

Missile 

1.17 

44 

5.10 

9.50 

Electronic 

1.24 

27 

2.20 

8.50 

Munition 

1.22 

7 

1.70 

7.70 

Vehicle 

1.71 

3 

3.00 

12.00 

Space 

1.16 

3 

2.00 

12.00 

Ship 

1.10 

14 

7.50 

9.10 

Other 

0.99 

3 

3.00 

5.70 

NOTE:  DE  baseline,  weighted  average,  mature  programs. 


Risk  and  uncertainty,  inherent  drivers  in  weapon  systems  development  cost 
growth,  pose  a  significant  challenge  to  the  cost  estimator.  In  an  attempt  to  minimize  risk 
and  uncertainty,  streamline  the  procurement  process,  and  decrease  eost  growth,  the  DoD 
has  implemented  numerous  aequisition  reform  initiatives  over  the  past  40  years.  Most 
recently,  the  October  30,  2002  memorandum  from  Undersecretary  of  Defense  Wolfowitz 
eanceled  the  DoD  5000  Defense  Aequisition  Policy  Documents  stating,  “I  have 
determined  that  the  current  subject  documents  require  revision  to  ereate  an  aequisition 
policy  environment  that  fosters  efficieney,  flexibility,  creativity,  and  innovation” 
(Wolfowitz,  2002).  Cancellation  of  the  DoD  5000  series  marks  the  latest  attempt  by  the 
DoD  to  minimize  weapon  system  cost  growth  and  minimize  negative  publie  opinion 
about  procurement  cost  overruns. 

Specific  Issue 

Historically,  cost  estimation  has  posed  a  tremendous  ehallenge  to  estimators  and 
program  managers  in  defense  weapons  system  proeurement.  Unrealistie  or  impreeise 
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weapon  system  eost  estimates  negatively  impaet  the  quality  of  deeisions  eoncerning  U.S. 
defense  policy;  distorting  the  rationale  for  resource  allocation  decisions.  An  occasional 
unrealistic  estimate  would  not  pose  a  significant  problem.  However,  even  despite 
acquisition  reform  initiatives  implemented  in  the  1970s  and  1980s  to  reduce  costs, 
research  has  shown  that  weapon  system  programs  during  this  period  continued  to 
experience  cost  and  schedule  overruns  regularly  (Searle,  1997:38).  In  the  1990s  and 
early  2000s,  additional  reform  initiatives  were  enacted  by  the  Clinton  and  Bush 
administrations  to  curb  this  trend.  Figure  1  displays  the  timeline  of  current  acquisition 
reform  initiatives.  While  the  last  three  DoD  acquisition  chiefs  have  deemed  the  current 
acquisition  reform  movement  successful  (Holbrook,  2003:2-3),  a  weapon  system  cost 
growth  statistical  analysis  is  needed  to  obtain  an  objective  measure  of  the  successfulness 
during  this  period. 


- 1 — w 1 - 1 — • 1 - 1 — m — I — m — I - 1 - 1 - 1 - 1 • — I •— 

1991  1992  1993  1994  1995  1996  1997  1998  1999  2000  2001  2002  2003 


Figure  1,  Current  Acquisition  Reform  Initiatives  (1991-2003) 
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Scope  and  Limitations  of  the  Study 

This  study  focuses  on  measuring  total  missile  systems  eost  growth  from  DoD 
Seleeted  Aequisition  Reports  (SAR)  by  applying  a  hybrid  adjusted  eost  growth  model, 
along  with  analyzing  the  impaet  of  reeent  aequisition  reform  initiatives  on  eost  growth 
over  time.  While  past  researeh  has  analyzed  eombined  program  eost  growth  over  all 
weapons  systems  programs,  this  study  attempts  to  identify  eost  growth  from  a  more 
miero-level  analysis.  The  SAR  is  one  of  the  few  offieial  management  reporting  systems 
that  provides  eonsistent  and  reasonably  reliable  data  on  the  status  of  DoD  aequisition 
programs  (Drezner  et  ah,  1993:7).  These  reports  are  developed  annually  at  the  program 
offiee  level  and  are  reviewed  by  the  Performanee  Management  Offiee  in  OUSD(A) 
before  they  are  released  in  eonjunetion  with  the  President’s  budget.  SARs  summarize  the 
latest  estimates  of  cost,  schedule  and  teehnieal  status,  while  separating  program  eost 
varianee  into  seven  eategories:  Eeonomie,  Quantity,  Estimating,  Engineering,  Sehedule, 
Support,  and  Other  (Drezner  et  ah,  1993:7). 

Eor  the  purpose  of  this  researeh,  the  SAR  provides  an  easily  aeeessible,  universally 
utilized  database  that  offers  suffieient  data  reliability;  however,  it  is  not  without 
limitations.  Aeeording  to  the  1993  RAND  report,  the  SAR  may  introduee  unaeeeptable 
error  in  the  eost  growth  ealeulation  unless  eare  is  taken  to  fully  understand  how  the  data 
was  generated  (Drezner  et  ah,  1993:9).  RAND  identified  the  following  problem  areas 
with  the  SAR: 

1 .  High  level  of  aggregation 

2.  Changing  baseline  estimate  and  program  restrueturing 

3.  Changing  preparation  guidelines  and  thresholds 
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4.  Inconsistent  allocation  of  cost  variances 


5.  Emphasis  on  effeets,  not  eauses 

6.  Ineomplete  coverage  of  program  eauses 

7.  Unknown  and  varied  budget  levels  for  program  risk 

Additionally,  security  classifications  of  sensitive  programs  may  render  some  cost  data 
unavailable  for  this  researeh.  Chapter  III  will  address  the  preeautions  taken  to  minimize 
the  effects  of  these  problem  areas  on  cost  growth  calculations. 

Research  Objectives 

This  research  has  two  main  objectives.  First,  the  study  quantifies  the  magnitude 
of  missile  system  cost  growth  from  1991  to  2001  using  a  hybrid  cost  growth 
methodology.  Capturing  the  current  cost  growth  trend  identifies  if  aequisition  programs 
have  improved  cost  overruns  or  if  they  eontinue  to  accumulate  approximately  20  percent 
cost  growth.  The  results  of  this  research  will  provide  insight  into  the  budgetary  status  of 
missile  systems  and  offer  DoD  offieials  a  cost  growth  model  that  ean  be  used  to 
determine  how  well  program  management  has  done  in  estimating  and  eontrolling  costs 
within  its  command.  The  results  of  this  research  will  provide  insight  into  the  budgetary 
status  of  missile  systems  and  offer  relevant  program  managers  a  tool  to  measure  their 
own  cost  growth  against  similar  programs. 

Second,  the  study  determines  the  impact  of  acquisition  reform  initiatives  on 
missile  system  cost  growth  from  1991  to  2001.  It  is  important  to  determine  if  continued 
aequisition  reform  efforts  are  actually  accomplishing  their  objeetives,  sinee  previous 
research  has  found  no  conclusive  evidence  that  aequisition  reform  has  reduced  eost 
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growth.  This  statement  is  further  reinforeed  in  the  1993  RAND  study  whieh  states,  “It 
seems  reasonable  to  expeet  that  the  myriad  of  initiatives  implemented  over  the  last 
several  deeades  intended  to  eontrol  eosts  and  improve  eost  estimating  eapabilities  would 
have  had  some  positive  effeet.  Unfortunately,  we  ean  detect  no  such  effect  in  the  data” 
(Drezner  et  ah,  1993:50).  If  a  reduction  in  cost  growth  is  found,  DoD  leadership  can  use 
this  analysis  to  estimate  the  amount  of  time  reform  initiatives  require  to  impact  cost 
growth.  However,  If  current  reform  initiatives  fail  to  prove  positive  impact  on  cost 
growth,  then  the  acquisition  community  and  legislators  may  need  to  rethink  the  current 
situation  and  address  the  problem  of  cost  growth  from  another  angle. 

Summary 

This  study  quantifies  the  magnitude  of  weapon  system  cost  growth  by  applying  a 
hybrid  adjusted  cost  growth  model  developed  by  RAND,  while  focusing  specifically  on 
the  area  of  missile  system  programs.  Expanding  on  the  cost  growth  determination,  this 
research  explores  the  impact  of  recent  acquisition  reform  initiatives  on  current  cost 
growth  trends.  Identification  of  current  cost  growth  levels  and  the  impact  of  acquisition 
reform  efforts  will  provide  program  managers  and  government  officials  insight  into  the 
effectiveness  of  the  acquisition  process  and  recent  legislation. 

Organization  of  the  Study 

This  chapter  established  the  motivation  for  analyzing  the  topic  and  the  research 
objectives.  Chapter  II  describes  past  and  present  acquisition  reform  efforts  and  highlights 
recent  cost  growth  studies.  Chapter  III  details  the  methodology  used  to  analyze  the 
quantitative  cost  data  and  Chapter  IV  identifies  the  results  of  the  analysis.  Finally, 
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Chapter  V  provides  conclusions  from  the  study  and  recommendations  for  further 
research. 
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II,  Literature  Review 


Chapter  Overview 

This  chapter  provides  a  description  of  missile  systems,  examines  both  historical 
and  current  aequisition  reform  initiatives,  and  reviews  recent  eost  growth  studies. 


Missile  Systems 

For  the  purpose  of  this  researeh,  a  missile  system  is  defined  as  any  weapon 
system  deemed  as  a  missile  system  in  the  Department  of  Defense  (DoD)  Cost  Analysis 
Improvement  Group  cost  growth  database.  Table  3  identifies  the  21  speeific  missile 
systems  reviewed  in  this  study  and  provides  each  program’s  technical  nomenclature 
along  with  any  common  name  in  parentheses. 


Table  3,  Missile  System  Programs 


AGM-65D  (Maverick) 

CBU-97B  (SFW) 

AGM-84A  (Harpoon) 

FGM-148A  (Javeline  AAWS) 

AGM-88  (HARM  USN) 

JDAM 

AGM-114(Hellfire) 

MIM-104  (Patriot) 

AGM-1 14K  (Hellfire  Longbow) 

MIM-104  (Patriot  PAC3) 

AIM-9X  (Sidewinder) 

Navy  Area  TBMD 

AIM-54C  (Phoenix) 

RIM-66M/67D  (SM-2  MR/ER) 

AIM- 120  (AMRAAM) 

RGM-109  (Tomahawk  MMM) 

ATACMS  P3I  (BAT) 

SAD  ARM  155mm  Projectile 

BLU-108  (JSOWAIWS) 

BLU-108  (JSOW  Unitary) 

SADARM  155mm  Roeket 

While  the  Army  and  Navy  comprise  about  two-thirds  of  all  missile  systems,  the 
Air  Foree  and  DoD  as  a  whole  also  maintain  ownership  of  specific  missile  systems 
analyzed  in  this  study. 
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Acquisition  Reform 

The  historical  overview  starts  with  Secretary  of  Defense  (SECDEF)  Robert 

McNamara’s  changes  in  1960  and  concludes  with  the  1989  Defense  Management  Report. 

The  current  reform  overview  begins  with  the  National  Performance  Review  (NPR)  and 

ends  with  a  summary  of  recent  DoD  5000  series  rewrites.  During  the  period  in  review, 

acquisition  reform  has  evolved  with  each  administration’s  reports  and  recommendations. 

The  most  recent  acquisition  reform  framework  is  as  follows: 

Acquisition  reform,  a  theory  pervasive  throughout  the  Department  of  Defense,  is 
an  endeavor  to  make  the  acquisition  process  more  effective,  efficient,  and 
productive.  It  involves  reducing  overhead,  streamlining  requirements,  speeding  up 
processes,  cutting  paperwork  and  other  similar  initiatives  to  reduce  bureaucracy. 
Acquisition  reform  includes  a  move  toward  the  use  of  commercial  practices  as 
well  as  the  use  of  private  enterprise  to  do  more  of  the  functions  traditionally  done 
by  government.  (What  is  Acquisition  Reform,  DSMC,  2001) 

Historical  Acquisition  Reform  Overview  (1960s  to  1990) 

Studies  by  the  Department  of  Defense  (DoD)  about  acquisition  reform  have  been 
conducted  over  the  past  40  years,  with  each  report  outlining  ways  to  simplify  and 
improve  the  weapons  procurement  processes  to  make  them  more  efficient  and  effective. 
Table  4  lists  some  of  the  defense  acquisition  reports  and  studies  conducted  from  the 
1960s  through  the  1980s.  This  historical  reform  summary  will  focus  on  those 
highlighted,  as  these  are  the  most  meaningful  and  significant  efforts  to  shape  the 
acquisition  process. 
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Table  4,  Significant  Defense  Acquisition  Studies  (Jones,  1996:405) 


Report  by 

Initiated  by 

Issued 

*McNamara  Initiatives 

SECDEF 

1961 

Peck  &  Scherer  (Harvard  Business  School) 

Authors 

1962,  1964 

*Packard  Initiatives 

Deputy  SECDEF 

1969-1970 

Blue  Ribbon  Defense  Panel  (Fitzhugh  Commission) 

President 

1970 

Commission  on  Government  Procurement 

Congress 

1972 

J.  Ronald  Fox  (Harvard  Business  School) 

Author 

1974 

Military  Services  and  Secretary  of  Defense 

DoD 

1974-75 

Defense  Science  Board  Summer  Study 

DoD 

1977 

(Acquisition  Cycle  Task  Force) 

Defense  Resources  Board 

DoD 

1979 

DoD  Resource  Management  Study 

President 

1979 

Jacques  S.  Gansler 

Author 

1980 

Acquisition  Improvement  Task  Force 

DoD 

1981 

(Carlucci  Initiatives) 

Special  Panel  on  Defense  Procurement  Procedures 

House  Armed  Services  Committee 

1982 

Grace  Commission 

President 

1983 

Special  Task  Force  on  Selected  Defense 

Senate  Armed  Services  Committee 

1984 

Procurement  Matters 

Georgetown  Center  for  Strategic  and  International  Studies 

Center 

1985 

Blue  Ribbon  Commission  on  Defense  Management 

President 

1986 

(Packard  Commission) 

Defense  Management  Review 

DoD 

1989 

‘Added  by  the  authors 

McNamara  Initiatives 

Acquisition  reform  efforts  began  in  the  1960s  in  an  attempt  to  fix  the  procurement 
system  when  “Secretary  of  Defense  (SECDEF)  Robert  S.  McNamara  (1961  to  1968) 
instituted  many  of  the  first  substantial  acquisition  reforms  through  his  centralized 
decision-making  apparatus  and  the  new  Plaiming,  Programming,  and  Budgeting  System” 
(Jones,  1999:402).  The  system  was  a  systematic  process  for  establishing  requirements 
and  incorporating  them  into  a  five-year  budget.  In  addition,  he  formed  the  Defense 
Supply  Agency,  Defense  Contract  Administration  Service,  and  Defense  Contract  Audit 
Agency;  all  organizations  designed  to  improve  the  government  acquisition  process. 
McNamara  also  initiated  industry  practices  used  at  Ford  Motor  Company  in  his  days  as 
an  executive  there  by  “establishing  requirements  for  analytical  rigor  in  evaluating  the 
need,  costs,  and  operational  effectiveness  of  new  weapons  systems”  (Reeves,  1996:16). 
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His  blueprint  for  evaluating  weapon  system  programs  through  concept  exploration, 
research  and  development,  and  production  phases  laid  the  framework  for  the  life  cycle 
process  used  in  program  offices  today.  Despite  these  significant  attempts  to  improve  the 
weapon  systems  procurement  process,  DoD  “continued  to  reward  cost  increases  and  to 
penalize  cost  reductions”  (Fox  and  Field,  1988:42),  prompting  future  Defense  Secretaries 
and  Congress  to  attempt  additional  reforms. 

Packard  Initiatives 

The  military  spending  draw  down  in  the  late  1960’s  enunciated  by  the  unpopular 
Vietnam  War  and  rising  cost  of  defense  acquisition,  prompted  David  Packard,  then 
Deputy  Secretary  of  Defense  (SECDEF)  under  the  Nixon  Administration,  to  recognize 
that  the  government  needed  a  better  way  to  manage  the  procurement  of  weapons  systems 
and  reduce  cost  growth  (Eerrara,  1996:1 10).  In  1996,  Deputy  Secretary  Packard 
“returned  to  the  Services  much  authority  for  conducting  the  acquisition  process”  (Jones, 
1999:402).  He  believed  it  was  essential  for  the  individual  services  to  have  autonomy 
over  their  programs,  while  OSD  maintained  some  program  oversight  (Pox  and  Pield, 
1988:44).  To  ensure  careful  evaluation  and  informed  decisions  were  made  before  a 
program  proceeded  to  the  next  phase.  Secretary  Packard  developed  the  Defense  Systems 
Acquisition  Review  Council  (DSARC)  “to  advise  him  of  the  status  of  each  major  defense 
system”  (Pox  &  Pield,  1988:44).  The  group  was  also  responsible  for  reviewing  the 
management  practices  of  major  programs  to  determine  if  reform  was  needed. 

In  May  1970,  Packard  released  a  memorandum  mentioning  further  changes  to 
streamline  the  acquisition  process  and  reduce  cost  growth  (Pox  and  Pield,  1988:44). 

Many  of  the  initiatives  in  Packard’s  memorandum  such  as  decentralized  program 
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execution,  streamlined  management  structures,  and  use  of  appropriate  contract 
mechanisms,  laid  the  foundation  for  the  first  DoD  Directive  5000.1,  “Acquisition  of 
Major  Defense  Systems”  (Ferrara,  1996:1 1 1).  Secretary  Packard’s  vision  as  outlined  in 
the  Directive  is  as  follows: 

Successful  development,  production,  and  deployment  of  major  defense  systems 
are  primarily  dependent  upon  competent  people,  rational  priorities,  and  clearly 
defined  responsibilities.  Responsibility  and  authority  for  the  acquisition  of  major 
defense  systems  shall  be  decentralized  to  the  maximum  practicable  extent 
consistent  with  the  urgency  and  importance  of  each  program. 

The  development  and  production  of  a  major  defense  system  shall  be  managed  by 
a  single  individual  (program  manager)  who  shall  have  a  charter  that  provides 
sufficient  authority  to  accomplish  recognized  program  objectives.  Layers  of 
authority  between  program  manager  and  his  Component  Head  shall  be 
minimum. . .  [the]  assignment  and  tenure  of  program  managers  shall  be  a  matter  of 
concern  to  DoD  Component  Heads  and  shall  reflect  career  incentives  designed  to 
attract,  retain,  and  reward  competent  personnel.  (Ferrara,  1996:1 1 1) 

The  final  section  of  DoDD  5000.1  contained  the  following  guidance  (Ferrara,  1996:1 12): 

•  Wherever  feasible,  operational  needs  shall  be  satisfied  through  the  use  of 
existing  military  or  commercial  hardware; 

•  Practical  tradeoffs  shall  be  made  between  system  capability,  cost,  and 
schedule; 

•  Logistic  support  shall  be  considered  as  a  principal  design  parameter; 

•  Schedules  shall  be  structured  to  avoid  unnecessary  overlapping  or 
concurrency; 

•  Test  and  evaluation  shall  commence  as  early  as  possible; 

•  Contract  type  shall  be  consistent  with  all  program  characteristics,  including 
risk; 

•  Source  selection  decisions  shall  take  into  account  the  contractor’s  capability; 

•  Develop  a  necessary  defense  system  on  a  timely  and  cost-effective  basis;  and 
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•  Documentation  shall  be  generated  in  the  minimum  amount  to  satisfy 
neeessary  and  specific  management  needs. 

Under  this  directive,  program  managers  were  to  “be  given  adequate  authority  to 

make  major  deeisions,  reeognition  and  rewards  for  good  work,  and  more  opportunity  for 

eareer  advancement”  (Fox  and  Field,  1988:45).  However  promising  this  may  have 

sounded,  it  produced  few  encouraging  changes  within  the  military  serviees  and 

established  no  aecountability  for  weapons  systems  cost  growth  (Fox  and  Field,  1988:  45). 

Ironically,  Secretary  Packard’s  visions  laid  forth  in  his  memorandum  over  thirty  years 

ago  are  still  the  underlining  theme  of  current  aequisition  reform  initiatives. 

Blue  Ribbon  Defense  Panel  (Fitzhugh  Commission) 

While  many  of  the  previous  major  Executive  led  reform  studies  focused  on 

government  procurement  in  general,  the  Blue  Ribbon  Defense  Panel,  enacted  in  July 

1969  by  President  Nixon  because  of  strong  publie  criticism  of  defense  proeurement, 

coneentrated  on  weapons  systems  aequisition.  The  Panel,  dubbed  the  Fitzhugh 

Commission  after  its  chairperson,  Gilbert  Fitzhugh,  issued  study  reports  that  were  “the 

first  systematic  evaluation  of  defense  aequisition  praetices”  (Reeves,  1996:16).  The 

eommission  was  explieitly  asked  to  comment  on  “defense  proeurement  policies  and 

practices,  particularly  as  they  relate  to  eosts,  time  and  quality”  (Bair,  1994:1 1).  The 

Panel  found  that  the  department’s  excessive  centralization,  the  Seeretary  of  Defense’s 

large  span  of  eontrol,  and  the  many  layers  of  management  had  “contributed  to  serious 

cost  overruns,  sehedule  slippages  and  performance  deficiencies”  (Fitzhugh  report, 

1970:2).  Essentially,  the  commission’s  recommendations  were  the  undoing  of  many  of 

the  centralized  business  praetices  initiated  by  Robert  McNamara  ten  years  earlier. 
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In  addition  to  the  advice  for  decentralization,  the  Panel  accentuated  the  need  for 
increased  prototype  testing,  flexibility  in  choosing  an  acquisition  strategy,  more 
professional  development  of  acquisition  personnel,  and  expanded  authority  for  program 
managers.  The  report  further  recommended  “that  fixed  price  contracts  should  not  be  used 
in  research  and  development  efforts”  because  of  the  “high  risks  and  many  technical  and 
engineering  unknowns  associated  with  these  efforts”  (Reeves,  1996:17).  Unfortunately, 
this  particular  recommendation  was  not  accepted  by  the  DoD  and  resulted  in  the  near 
bankruptcy  in  the  late  1980s  of  several  defense  contractors  accepting  fixed  price  contracts 
for  research  and  development  efforts,  including  LTV  Corporation  and  Northrop 
Grumman.  Ironically,  not  until  after  these  incidents  did  the  DoD  finally  decide  against 
the  use  of  fixed  price  contracts. 

Of  the  Panel’s  recommendations,  exclusive  of  the  non  use  of  fixed  price  contracts 
previously  described,  most  were  embraced  by  the  DoD  and  “virtually  mirrored”  the 
initiatives  established  by  David  Packard  (Bair,  1994:13).  Many  have  implied  that  the 
Panel’s  reports,  because  of  their  initiation  by  the  President  and  support  from  the 
Congress,  affirm  the  recommendations  earlier  issued  by  Packard.  However,  because  the 
Panel’s  recommendations  were  left  to  the  DoD  to  implement  and  did  not  require 
Congressional  action,  few  of  the  initiatives  were  actually  implemented.  In  fact,  similar 
recommendations  were  again  made  in  the  1985  Packard  Commission  report,  raising  the 
question  of  implementation  effectiveness  of  the  Panel’s  initiatives. 

Commission  on  Government  Procurement 

All  previous  efforts  to  reform  the  acquisition  process  and  reduce  cost  growth  were 
directed  by  either  the  Secretary  of  Defense  or  the  President.  The  Commission  on 
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Government  Procurement  was  the  first  such  attempt  by  Congress  and  was  designed  as  a 
comprehensive  review  of  all  government  buying  practices  and  procedures  (Bair,  1994:13- 
14).  The  creation  of  the  commission  was  prompted  by  growing  concern  that  the  federal 
procurement  practices  were  ineffective  because  of  a  lack  of  uniformity  and  an  increase  in 
complexity.  The  commission’s  initial  findings  revealed: 

•  Congress  was  ill-equipped  to  evaluate  performance,  costs,  and  schedule  for 
new  defense  systems  programs  in  the  context  of  national  security  objectives 
and  priorities. 

•  Congress  should  establish  an  Office  of  Federal  Procurement  Policy  headed  by 
a  presidential  appointee  to  oversee  procurement  policies  and  systems. 

•  Congress  should  consolidate  all  statutory  procurement  regulations  into  one. 

•  DoD  should  upgrade  the  acquisition  workforce  by  establishing  an  institution 
to  provide  necessary  education  and  services. 

•  DoD  should  reduce  the  management  and  administration  layers  between  policy 
and  program  offices  (Fox  and  Field,  1988:45). 

The  commission’s  report  emphasized  how  uncoordinated  and  often  inconsistent 
the  procurement  regulations,  practices,  and  procedures  were,  and  how  the  volumes  of 
expensive  paperwork  continued  to  increase.  They  also  stressed  the  need  to  stem  the 
growing  procurement  procedure  complexity  to  make  doing  business  with  the  government 
easier.  The  commission  reiterated  numerous  finding  from  the  Fitzhugh  commission 
reports,  including  the  use  of  competitive  negotiated  contract  methods,  encouraging 
greater  use  multiyear  contracts,  government-wide  professional  development  programs  for 
procurement  personnel,  using  metrics  to  report  the  progress  and  status  of  proposed 
changes,  raising  the  small  purchase  and  economic  thresholds  from  $2,500  to  $10,000, 
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introducing  an  independent  operational  test  and  evaluation  program,  and  inereasing  the 
authority  of  program  managers  (Reeves,  1996: 18). 

Ironieally,  while  many  of  the  reeommendations  were  moves  in  the  right  direetion, 
pentagon  offieials  still  believed  that  DoD  had  already  made  internal  shifts  in  their 
proeurement  praetiees  from  reeommendations  made  earlier  by  the  Fitzhugh  eommission, 
and  that  more  time  was  needed  to  assess  their  results  before  additional  reforms  were 
implemented.  The  few  reeommendations  by  the  eommission  that  were  finally 
implemented  had  lasting  effects  on  the  proeurement  proeess:  Office  of  Federal 
Proeurement  Poliey  ereated  (1974);  Contraet  Disputes  Aet  enaeted  (1978);  Federal 
Aequisition  Regulation  system  established  (1980);  Competition  in  Contracting  Act 
enacted  in  (1984);  and  the  legislative  formation  of  the  Federal  Aequisition  Institute 
(1993)  (Bair,  1994:15). 

Carlueei  Initiatives 

The  intensifying  Cold  War  fueled  defense  spending  inereases  during  the  last  two 
years  of  the  Carter  Administration,  and  President  Reagan’s  eampaign  promise  for 
aceelerated  defense  buildup  (Benson,  1996:19).  The  rapid  inerease  in  defense  spending 
brought  with  it  a  new  round  of  ehanges  in  the  aequisition  proeess.  In  1981,  in  order  to 
manage  these  reforms,  Seeretary  of  Defense  Weinberger  ordered  the  Aequisition 
Improvement  Task  Foree;  also  know  as  the  Defense  Aequisition  Improvement  Program 
(DAIP)  to  “evaluate  all  faeets  of  defense  aequisition”  (Jones,  1999:406).  The  team  was 
headed  by  Deputy  Seeretary  of  Defense  Frank  C.  Carlueei. 

The  DAIP  released  a  list  of  32  management  initiatives,  aimed  at  decreasing 
weapons  eost,  redueing  development  time,  and  improving  weapons  support  and 
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readiness.  Of  the  initiatives  proposed  in  Table  5,  multiyear  procurement  contracts, 
greater  contracting  competition,  stabilized  programs,  more  realistic  budgeting,  and  more 
fixed-price  contracts  were  eventually  established  and  instituted  by  DoD  (Fox  and  Field, 
1988;  47-48). 


Table  5,  Carlucci  Initiatives  (Adams,  1984, 15) 


1.  Reaffirm  Acquisition  Management  Principles  17. 

2.  Increase  Use  of  Preplanned  Product  18. 

Improvement  19. 

3.  Implement  Multiyear  Procurement  20. 

4.  Increase  Program  Stability  21. 

5.  Encourage  Capital  Investment  to  Enhance 

Productivity  22. 

6.  Budget  to  Most  Likely  Costs  23. 

7.  Use  Economical  Production  Rates  24. 

8.  Assure  Appropriate  Contract  Type  25. 

9.  Improve  System  Support  and  Readiness  26. 

10.  Reduce  Administrative  Costs  and  Time  27. 

11.  Budget  for  Technological  Risk 

12.  Provide  Front-end  Funding  for  Test  Flardware  28. 

13.  Reduce  Governmental  Legislation  Related  29. 

Acquisition  30. 

14.  Reduce  number  of  DoD  Directives  31 . 

15.  Enhance  Funding  Flexibility  32. 

16.  Provide  Contractor  Incentives  to  Improve  33. 

Reliability 


Decrease  DSARC  Briefing  and  Data  Requirements 
Budget  for  Inflation 
Forecast  Business  Base  Conditions 
Improve  Source  Selection  Process 
Develop  and  Use  Standard  Operation  and 
Support  Systems 

Provide  More  Appropriate  Design-to-Cost  Goals 
Implement  Acquisition  Process  Decisions 
Reduce  DSARC  Milestones 
Submit  MENS  (later  JMSNS)  with  Service  POM 
Revise  DSARC  Membership 
Retain  USDR&E  as  Defense  Acquisition 
Executive 

Raise  Dollar  Threshold  for  DSARC  Review 
Integrate  DSARC  and  PPBS  Process 
Increase  PM  Visibility  of  Support  Resources 
Improve  Reliability  and  Support 
Increase  Competition 
Enhance  the  Defense  Industrial  Base 

(added  1984) _ 


The  Carlucci  initiatives  addressed  some  of  the  longstanding  sources  of  cost 

growth,  and  many  of  the  themes  made  their  way  into  the  1982  revision  of  the  DoD 

Directive  5000.1  series,  which  at  the  time  was  the  foundation  for  defense  acquisition 

guidance.  The  revisions  reflected  the  principles  and  policies  recommended  by  the 

Acquisition  Improvement  Program,  and  are  evident  in  this  excerpt  from  the  1982  version: 

Improved  readiness  and  sustainability  are  primary  objectives  of  the  acquisition 
process....  Reasonable  stability  in  acquisition  programs  is  necessary  to  carry  out 
effective,  efficient,  and  timely  acquisitions.  To  achieve  stability,  DoD 
Components  shall  conduct  effective  evolutionary  alternatives,  estimate  and 
budget  realistically,  [and]  plan  to  achieve  economical  rates  of  production. 

(Ferrara,  1996:119) 
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Carlucci  believed  that  in  order  for  the  changes  to  be  successful,  DoD  not  only 
required  procurement  process  changes,  but  also  philosophical  changes  to  confront  the 
“traditional  way  of  doing  business”  (Jones,  1999:407).  A  July  1996  General  Accounting 
Office  (GAO)  report,  assessing  the  effectiveness  of  the  Carlucci  initiatives,  found  that 
while  the  reforms  were  at  least  partially  successful  in  improving  parts  of  the  acquisition 
process,  many  of  the  program  managers  responsible  for  implementing  the  changes  felt 
that  the  reforms  “had  made  little  or  no  difference  in  the  acquisition  process”  (Fox  and 
Field,  1988:  48).  The  report  suggested  that  the  “philosophical”  changes  Carlucci  stressed 
had  not  been  taken,  and  “senior-level  commitment  to  change  had  not  filtered  down  to  the 
program  management  level”  (Fox  and  Field,  1988:48).  GAO  further  emphasized  the 
difficulty  in  implementing  the  reforms  in  an  environment  where  “everyone  was  in  a  hurry 
to  make  short-term  fixes”  (Jones,  1999:407).  Perhaps  the  most  telling  comment  in  the 
GAO’s  report  was  the  perception  that  the  “commitment  to  the  improvement  program  had 
dissipated”  (Munechika,  1997:8).  While  only  five  years  had  passed  since  the  Carlucci 
initiatives  were  implemented,  DoD  lost  focus  executing  and  monitoring  the  results; 
ultimately  contributing  to  a  perceived  failure  in  the  reforms  (Holbrook,  2003:10). 

Grace  Commission 

During  President  Reagan’s  1980  campaign  run,  he  pledged  to  reduce  federal 
budget  spending  by  two  percent  through  the  identification  and  elimination  of  “waste, 
extravagance,  abuse,  and  outright  fraud”  in  federal  programs  (Bair,  1994:16).  In  1982,  to 
follow  through  with  his  promise.  President  Reagan  established  the  President’s  Private 
Sector  Survey  on  Cost  Control  (PPSSCC),  also  known  as  the  Grace  Commission,  named 
after  its  chairperson,  Peter  J.  Grace.  The  group  consisted  of  161  chief  executive  officers 
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of  major  corporations  and  private  sector  experts;  their  aim  was  to  identify  ways  the 
government  could  be  more  efficient  and  reduce  costs,  either  through  executive  or 
legislative  action  (Holbrook,  2003:10). 

The  Commission  reeommended  2,478  government  reform  initiatives  to  the 
President,  with  estimated  eost  savings  of  $424  billion  over  three  years.  Of  the 
recommendations,  only  112  pertained  directly  to  DoD,  and  of  these,  12  directly  involved 
the  acquisition  process  (US  Congress,  1984).  The  major  aequisition  reform  initiatives  are 
listed  below  in  Table  6. 


Table  6.  Grace  Commission  Recommendations  (House  Armed  Services  Committee, 

1985:3) 

1.  Greater  use  of  multiyear  contracting  to  improve  program  stability 

2.  Prioritize  all  weapons  systems 

3.  Streamline  and  strengthen  the  contract  selection  process 

4.  Upgrade  cost  estimating 

5.  Enhance  the  role,  responsibility,  authority  and  accountability  of  the  PM 

6.  Increase  the  use  of  dual  sources,  throughout  the  life  of  the  program 

7.  Increase  emphasis  on  the  Spare  Parts  Breakout  Program  to  identify  and  obtain  spare  parts 
from  sources  other  than  the  Prime  Contractor 

8.  Consolidate  responsibility  for  contract  administration  activity  at  the  level  of  OSD 

9.  Simplify/streamline  the  30,000  pages  of  regulation  related  to  Defense  procurement 

10.  Mandate  use  of  common  components,  subsystems  and  equipment  by  all  services 

1 1 .  Eliminate  the  use  of  unnecessary  military  specifications 

12.  Outsource  commercial  functions 


The  main  focus  of  the  Commission’s  report  was  an  emphasis  on  “sound  business 
practices”  to  reduce  cost  overruns  rather  than  slashing  those  programs  experiencing  costs 
increases  (Bair,  1994:16).  The  report  identified  a  compelling  need  to  modernize  and 
streamline  the  acquisition  process,  and  overhaul  the  organization  structure  by 
consolidating  the  procurement  function  at  the  OSD  level.  Once  again  the  reform  theme 
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shifted  back  to  centralized  management,  as  recommended  by  McNamara  more  than  20 
years  before.  The  report  asserted; 

The  military  services  have  never  really  bought  into  the  need  for  central 
management  by  the  SECDEF. .  .Congress  continually  constricts  DoD’s 
management  prerogatives. .  .weapons  choices. .  .and  other  major  management 
decisions  cannot  be  made  in  isolation  from  home  district  political  pressures. 
(Grace  Report,  1983:ii) 

Critics  of  the  Commission’s  claims  charged  that  the  estimated  potential  savings 
were  overstated  and  that  many  suggestions  were  not  improvements  in  efficiency  or 
eliminations  of  waste,  but  rather  characterized  as  changes  in  national  policy  (Bair, 
1994:17).  Opponents  of  the  proposals  suggested  that  congressional  policy  changes  were 
necessary  for  the  reforms  to  be  successful,  and  that  Congress  would  take  little  or  no 
action  to  ratify  any  recommendations.  In  addition,  numerous  senior  DoD  leaders 
believed  that  many  of  the  recommendations  were  already  being  addressed  and  that  the 
department  was  moving  in  the  right  direction  under  the  Carlucci  initiatives.  Ultimately, 
both  the  Grace  and  Carlucci  recommendations  lost  steam  and  faded,  while  cost  overruns 
continued  to  grow  (Munechika,  1997:12). 

.Packard  Commission 

According  to  historical  budget  data  from  the  Congressional  Budget  Office, 
between  1980  and  1985  Defense  outlays  increase  over  88  percent.  With  the  tremendous 
increase  in  spending  came  several  highly  publicized  procurement  horror  stories  and  cost 
overruns  that  created  public  doubt  about  the  wisdom  of  DoD  weapons  systems  purchases 
(Jones,  1999:398).  According  to  one  expert,  there  were  many  reasons  for  alarm  in  the 
defense  acquisition  community: 
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In  the  mid-1980s,  an  atmosphere  of  uneertainty,  frustration,  and  apprehension 
pervaded  the  Pentagon  and  its  contracting  base,  for  each  new  day  brought  with  it 
additional  regulations  and  concerns  that  more  errors  would  be  uncovered  by  either 
the  press  of  congressional  auditors,  investigators,  and  overseers...  the  logjam  of 
procurement  legislation  awaiting  implementation  had  become  so  great  that  the 
Pentagon  and  defense  industry  officials  pleaded  with  Congress  for  a  moratorium 
on  further  reform  legislation.  (Fox  and  Field,  1988:1 19) 

In  an  effort  to  curb  growing  concern.  President  Reagan  responded  with  the 

formation  of  the  Blue  Ribbon  Commission  on  Defense,  better  know  as  the  Packard 

Commission,  named  after  its  chairperson,  former  Secretary  of  Defense  David  Packard 

(Benson,  1996:20).  The  Commission’s  charter  was  to  “examine  ways  to  improve  defense 

management  in  general,  and  defense  acquisition  specifically”  (Ferrara,  1996:1 19).  Their 

focus  was  on  “broad,  structural  changes  rather  than  on  the  smaller  issues  of  fraud,  waste, 

and  abuse,”  which  the  group  felt  were  symptoms  rather  than  the  cause  of  the  problems 

(Jones,  1999:407). 

Less  than  one  year  after  the  Commission  was  organized,  they  submitted  their  final 
report  to  the  President.  The  principal  recommendations  were: 

•  Create  a  new  position  of  Under  Secretary  of  Defense  for  Acquisition 
(USD[A])  with  responsibility  for  research,  development,  procurement  and 
testing  of  all  weapon  systems. 

•  Created  acquisition  executives  (AEs)  in  each  Service  reporting  to  both  the 
USD(A)  and  their  Service  Secretaries. 

•  Create  program  executive  officers  reporting  directly  to  the  AEs,  each 
overseeing  a  group  of  program  managers. 

•  Give  the  Chairman  of  the  JCS  more  authority  in  acquisition  matters,  create  a 
Vice  Chairman,  and  create  a  Joint  Requirements  Management  Board  to 
establish  weapons  systems  requirements,  with  approval  or  rejection  authority 
at  each  milestone  (Jones,  1999:407). 
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In  addition  to  these  recommendations,  the  Commission  developed  a  “model  of 
excellence  for  defense  acquisition,”  and  provided  a  “formula  for  action”  to  make  the 
process  more  efficient  (Munechtka,  1997:13).  Table  7  shows  the  Packard  Commissions 
Formula  for  Action. 

Table  7,  Packard  Commission’s  Formula  for  Action 

A.  Streamline  Acquisition  Organization  and  Procedures 

1 .  Create  new  Under  Secretary  of  Defense  for  Acqusition  position 

2.  Each  service  should  establish  a  comparable  Service  Acquisition  Executive  (SAE) 

3.  Each  SAE  should  appoint  Program  Executive  Officers  (PEO) 

4.  Program  managers  report  directly  to  PEOs 

5.  Substantially  reduce  the  number  of  acquisition  personnel 

6.  Recodify  federal  laws  into  a  single,  greatly  simplified  statute 

B.  Use  Technology  to  Reduce  Cost 

1.  Emphasize  building  and  testing  prototypes  to  demonstrate  new  technology 

2.  Operational  testing  should  begin  early  in  development 

3.  Prototypes  can  provide  a  basis  for  improved  cost  estimating 

C.  Balance  Cost  and  Performance 

1.  Restructure  Joint  Requirements  and  Management  Board  leadership 

2.  Joint  Requirements  Management  Board  should  define  weapon  requirements  and  provide 
tradeoff  between  cost  and  performance 

D.  Stabilize  Programs 

1.  Baseline  programs  and  use  multi-year  funding 

E.  Expand  the  Use  of  Commercial  Products 

1 .  Do  not  rely  on  military  specifications 

2.  Use  off-the-shelf  products  as  much  as  possible 

F.  Increase  the  Use  of  Competition 

1.  Focus  on  more  effective  competition,  modeled  on  commercial  practices 

2.  Emphasize  quality  and  past  performance  as  well  as  price 

G.  Enhance  the  Quality  of  Acquisition  Personnel 

1.  Allow  Secretary  of  Defense  to  establish  flexible  personnel  management  practices 

2.  Recommend  new  personnel  management  system  for  acquisition  personnel, 

contracting  officers  and  scientists  and  engineers 


Both  the  President  and  Congress  responded  enthusiastieally  to  the 
reeommendations,  and  on  Oetober  1,  1986,  President  Reagan  signed  into  law  the 
Goldwater-Niehols  and  Department  of  Defense  Reorganization  Aet,  bringing  sweeping 
ehanges  whose  prineipal  provisions  were  to  implement  the  primary  Paekard 
Commission’s  suggestions  (Jones,  1999:408).  Shortly  after  the  Commission’s  report  and 
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this  Act,  DoD  ordered  revisions  to  the  DoD  5000.1  series  to  eapture  the  efforts  in  the 
basie  governing  aequisition  regulation. 

In  1990,  an  Under  Seeretary  of  Defense  for  Aequisition  report  analyzing  the 
reform  progress  provided  specifie  positive  examples  of  inereased  eost  eontrol  and 
stronger  program  stability: 

•  Multiyear  eontracting.  Seven  multiyear  programs  were  approved  by  Congress 
in  the  FY  1989  budget,  saving  an  estimated  $492  million.  Total  savings  from 
multiyear  procurements  from  FY  1982  to  FY  1989  exeeed  $7.5  billion. 

•  Eeonomie  produetion  rate.  Of  the  34  major  defense  acquisition  programs  in 
the  DoD,  30  were  planed  for  procurement  at  or  better  than  the  minimum 
eeonomie  produetion  rate  (Munechika,  1997:15). 

After  various  progress  reports  on  the  Commission’s  results  were  positive,  and  key 
DoD  leadership  touted  the  reform  a  sueeess.  President  Reagan’s  efforts  were  viewed  by 
some  as  the  most  substantive  defense  aequisition  reform  aehievements  to  date  (Jones, 
1999:407).  However  suecessful  the  Paekard  Commission’s  efforts,  they  still  were  not 
without  erities.  Many  argued  that  little  progress  was  made  enhaneing  the  quality  of  DoD 
aequisition  personnel  (Muneehika,  1997:15).  Also,  a  report  published  by  Christensen  et 
al.  (1999)  analyzing  the  DAES  database  for  program  eost  growth,  showed  that  the 
Paekard  Commissions  results  did  not  reduce  eost  overruns.  It  would  be  the  foeus  of  the 
first  Bush  Administration  to  aggressively  investigation  the  “sueeess”  of  the 
Commission’s  efforts  upon  taking  office  in  1989  (Holbrook,  2003:14). 

Defense  Management  Review 

Early  in  1989,  President  Bush  direeted  Seeretary  of  Defense  Richard  Cheney  to 
develop  a  plan  to  ensure  the  Paekard  Commission’s  reeommendations  were  fully 
implemented;  and  to  further  improve  and  more  effieiently  manage  the  defense  aequisition 


23 


system  (Cheney,  1989:i).  The  DoD  in-house  study  was  known  as  the  Defense 
Management  Review  (DMR).  It  assessed  from  an  analytical  view  how  far  along  the  DoD 
was  is  implementing  the  Commission’s  recommendations,  and  what  remained  to  be 
accomplished  (Holbrook,  2003:14).  The  DMR’s  initial  findings  criticized  management 
in  the  acquisition  community  for  the  undisciplined  management  process  and 
overburdening  regulations  (Ferrara,  1996:121).  The  Secretary  released  a  list  of  changes 
that  were  deemed  necessary  in  order  for  the  President’s  objectives  at  improving  the 
procurement  system  to  work: 

•  Teamwork  among  DoD’s  senior  managers; 

•  Sound,  longer-range  planning  and  better  means  for  managing  available 
resources; 

•  More  discipline  in  what  weapon  systems  we  buy  and  how  we  buy  them; 

•  Better  management  of  the  people  we  rely  on  to  produce  such  systems; 

•  An  environment  that  promotes  steady  progress  in  cutting  costs  and  increasing 
quality  and  productivity;  and 

•  Adherence  to  the  highest  ethical  standards  (Cheney,  1989:27). 

DMR  also  instituted  a  list  of  improvements  that  included  “streamlining  the 
acquisition  chain-of-command  from  the  Defense  Acquisition  Executive  through  a  newly 
created  Service  Acquisition  Executive  (SAE)”,  having  the  Chairman  of  the  Joint  Chiefs 
of  Staff  (JCS)  lead  the  Joint  Requirements  Oversight  Council  to  improve  requirements 
generation  and  enhance  weapon  system  performance  validation,  and  strengthening  the 
power  of  the  Under  Secretary  for  Acquisition  (Hinnant,  1993:6;  Jones,  1999:404). 
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By  the  end  of  1991,  one  of  the  DMR’s  most  influential  initiatives,  entitled 
“Streamlining  Contract  Management,”  had  been  implemented.  Its  aim,  a 
recommendation  proposed  five  years  earlier  by  the  Grace  Commission;  was  to 
consolidate  the  Army,  Navy,  and  Air  Force  contract  administrations  under  a  single 
organization  -  the  Defense  Logistics  Agency  (DLA)  (Munechika,  1997:16).  Also  in 
1991,  came  the  release  of  the  overhauled  DoD  5000  series;  a  concerted  effort  to  respond 
to  the  DMR’s  critique  (Ferrara,  1996:121).  The  four  main  objectives  of  the  rewrite  were: 
1)  create  a  uniform  system  of  acquisition  policy,  2)  discipline  the  acquisition 
management  process,  3)  streamline  the  acquisition  regulatory  regime,  and  4)  address  the 
litany  of  common  complaints  (Ferrara,  1996:121).  The  focus  of  attention  in  the 
acquisition  process  after  the  DMR’s  recommendation  was  a  shift  “to  a  more  formalized 
report  based  interaction  in  which  all  necessary  information  would  be  transmitted  in 
writing”  (Ferrara,  1996:121).  However,  this  method  would  later  be  reversed  because  of 
an  increase  in  “red  tape”  and  “bureaucracy”,  which  down  the  acquisition  process. 

Summary 

This  section  provided  a  brief  overview  of  some  of  the  major  acquisition  reform 
initiatives  between  1960  and  1989.  From  a  historical  point  of  view,  it  is  evident  that 
while  the  reform  studies  and  commissions  have  changed  names,  many  of  the  ideas  and 
recommendations  remained  the  same  between  McNamara  (1961),  Packard  (1969  to 
1970),  Fitzhugh  Commission  (1970),  Commission  on  Government  Procurement  (1972), 
Carlucci  Initiatives  (1981),  Grace  Commission  (1983),  Packard  Commission  (1986)  and 
the  Defense  Management  Review  (1989). 
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Current  Acquisition  Reform  Overview  (1991  to  2003) 

This  section  defines  the  current  acquisition  reform  period  as  those  initiatives 
which  were  enacted  from  1991  to  2003.  This  section  examines  the  National  Performance 
Review  (NPR),  the  Federal  Acquisition  Streamlining  Act  (FAS A),  the  Clinger-Cohen  Act 
of  1996,  and  the  DoDD  5000  series  rewrites. 

National  Performance  Review  (NPR)  of  1993  and  1995 

The  National  Performance  Review  (NPR)  focused  on  transforming  the  current 
procurement  system  into  one  which  had  more  customer  service,  less  bureaucracy,  and 
was  primarily  based  on  getting  value  for  money  (Reinventing  Federal  Procurement, 
1993:7).  Five  major  themes  were  identified  and  provided  the  framework  for  20  specific 
reform  recommendations.  Table  8  identifies  the  five  major  NPR  themes  and  summarizes 
some  of  the  key  recommendations. 
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Table  8,  NPR  Procurement  Reform  Recommendations  (Reinventing  Federal 

Procurement,  1993) 


Move  to  Guiding  Principies  from  Rigid  Ruies 

PROC01  Reframe  Acquisition  Poiicy 

-  Reduce  ruies  and  reguiations 
PROC02  Buiid  an  Innovative  Procurement  Workforce 

-  Better  education  and  training 
PROC03  Encourage  More  Procurement  Innovation 

-  Test  new  methods  with  piiot  programs 
Get  Bureaucracy  Out  of  the  Way 

PROC04  Estabiish  New  Simpiified  Acquisition  Threshoid  and  Procedures 

-  Low  cost  procedures  for  smaii  purchases 
PROC06  Amend  Protest  Ruies 

-  Increased  communication  between  buyers  and  seiiers 
PROC08  Reform  Information  Technoiogy  Procurement 

-  Decrease  time  to  purchase  computer  equipment 
Center  Authority  and  Accountabiiity  with  Line  Managers 

PROC09  Lower  Costs/Reduce  Bureaucracy  in  Smaii  Purchases  though  Purchase  Card  Use 

-  IMPAC  Card  use 

Create  Competitive  Enterprises 

PROC12  Aiiow  for  Expanded  Choice  and  Cooperation  in  use  of  Suppiy  Scheduies 

-  Increase  Number  of  Supply  Sources 

Foster  Competitiveness,  Commerciai  Practices,  Exceiience  in  Vendor  Performance 

PROC13  Foster  Reliance  on  the  Commercial  Marketplace 

-  Reduce  reliance  on  government-specific  specifications 
PROC15  Encourage  Best  Value  Procurement 

-  Lowest  bidder  is  not  always  best! 

PROC16  Promote  Excellence  in  Vendor  Performance 

-  Use  past  performance  in  contract  award  decisions 
PROC18  Authorize  multiyear  contracts 


“In  December  1994,  President  Clinton  asked  Vice  President  Gore  to  conduct  a 
second  review  of  federal  agencies,  focusing  on  whether  existing  functions  could  be 
terminated,  privatized,  or  restructured”  (National  Partnership  for  Reinventing 
Government,  1999:4).  Commonly  referred  to  as  Reorganizing  Government  Phase  11 
(REGO  11),  this  second  review  featured  four  concurrent  efforts  which  are  outlined  in 
Table  9. 
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Table  9,  NPR  Phase  II  Procurement  Reform  Efforts  (Reinvention  Roundtable 

1995:6) 

Agency  Resturcturing  (considers  three  questions) 

-  If  your  agency  were  eliminated,  who  would  pusrue  its  goals? 

-  If  we  must  retain  this  federal  role,  how  can  we  improve  customer  service  and  reduce  costs? 

-  What  do  you  think  your  customers  think  about  eliminations  or  changes? 

Realigning  Relationship  of  Federal  Government  with  State/Local  Partners 

-  Pass  maximum  authority  and  funding  to  states,  localities,  and  individuals. 

-  If  federal  role  required,  the  federal  government  will  be  a  partner  who  "steers,  not  rows." 

Regulatory  Reform 

-  Regulators  must  change  the  regulatory  culture. 

Continued  Implementation  of  NPR  Phase  I 

-  Agencies  will  continue  to  build  on  successes  of  NPR  Phase  I 


Actual  NPR  savings  appear  to  be  eontested  between  federal  agencies;  however, 
the  importance  of  the  NPR  as  it  relates  to  this  study  was  that  it  reinvigorated  the 
Aequisition  Reform  movement  in  the  DoD  (Holbrook,  2003:15). 

Federal  Aequisition  Streamlining  Act  (FAS A)  of  1994 

“The  Federal  Aequisition  Streamlining  Aet  of  1994  significantly  changed  how  the 
government  does  business.  As  part  of  Vice  President  Gore’s  effort  to  ereate  a 
‘Government  That  Works  Better  and  Costs  Less’  within  his  National  Performanee 
Review,  he  presented  FAS  A  to  President  Clinton  in  1983.  It  was  designed  to  overhaul 
the  cumbersome  and  complex  procurement  system  of  the  federal  government,  which 
required  costly  paperwork  for  even  small  purchases  and  weeks,  sometimes  months,  of 
waiting  between  order  and  delivery  of  goods”  (FASA  DSMC,  2002).  To  this  end,  the  act 
significantly  modified  or  eliminated  over  225  existing  statutes. 

“The  themes  behind  the  changes  made  by  FASA  are  a  preference  for  moving  to 
eommereial  eontracting  methods,  transitioning  the  procurement  process  to  an  electronie 
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basis,  eliminating  paperwork  burdens  in  the  procurement  cycle,  and  eliminating  non¬ 
value-added  requirements”  (Statutory/Policy  Changes  1999:1).  Table  10  highlights  some 
of  the  changes  included  in  the  FASA  of  1994. 

Table  10.  Federal  Acquisition  Streamlining  Act  of  1994  (FASA  DSMC,  2002) 

-  Eliminated  paperwork  and  record  keeping  requirements  for  purchases  under  $100,000 

-  Allowed  direct  micropurchases  of  items  below  $2,500 

-  Exempted  commercial  procurements  from  certain  cost  accounting  standards 

-  Reserved  all  acquisitions  ($2,500  -  $100,000)  for  small  business  concerns 

-  Expanded  Small  Disadvantaged  Business  program  to  civilian  agency  purchases 

-  Created  Small  Business  Procurement  Advisory  Council 

-  Improved  bid  protest  and  contract  administration  procedures 

-  Required  evaluation  of  past  performance  before  contract  award 

Clinger-Cohen  Act  of  1996 

In  1996,  Congress  and  the  President  enaeted  the  Information  Teehnology 
Management  Reform  Aet  and  the  Federal  Aequisition  Reform  Aet,  whieh  are  jointly 
known  as  the  Clinger-Cohen  Aet  of  1996.  Among  other  ehanges,  this  aet  required  heads 
of  Federal  ageneies  to  link  information  teehnology  (IT)  investments  to  ageney 
aeeomplishments  and  establish  a  proeess  to  seleet,  manage,  and  eontrol  IT  expenditures 
(Clinger-Cohen  Aet  of  1996,  DSMC,  2001).  The  following  quote  by  former  Under 
Seeretary  of  Defense  for  Aequisition  and  Teehnology,  Paul  G.  Kaminski,  summarizes  the 
aet’s  aeeomplishments. 

The  Clinger-Cohen  Aet  of  1996  (formerly  known  as  the  Federal 
Aequisition  Reform  Aet  of  1996  (FARA)  and  the  Information  Teehnology 
Management  Reform  Aet  of  1996  (ITMRA))  further  advanee  the  ehanges 
made  by  FASA.  The  Clinger-Cohen  Aet  provides  a  number  of  signifioant 
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opportunities  for  DoD  to  further  streamline  and  reduee  non-value  added 
steps  in  the  aequisition  proeess.  Among  the  most  signifieant  ehanges 
authorized  by  the  Aet  is  a  test  of  the  use  of  the  Simplified  Aequisition 
Proeedures  (SAP)  for  eommereial  items  between  the  simplified  aequisition 
threshold  of  $100,000  and  $5  million.  This  should  allow  DoD  to  reduee 
its  administrative  eosts  and  overhead  eosts  for  DoD’s  vendor  base  for 
purehases  of  relatively  low  risk  items.  This  ehange  eliminated 
government-unique  requirements  previously  eited  by  industry  as  a  barrier 
to  doing  business  with  DoD.  The  Aet  also  provides  the  authority  for 
eontraeting  aetivities  to  use  SAPs  for  all  requirements  between  $50,000 
and  the  SAP  while  the  government  works  to  fully  implement  Eleetronie 
Commeree/Eleetronie  Data  Interehange  (EC/EDI).  (Clinger-Cohen 
DSMC,  2001) 

Overall,  ehanges  initiated  by  the  Clinger-Cohen  Aet  provided  substantial  relief 
from  burdensome  non-value  added  proeesses  that  inereased  the  eost  of  IT  aequisition 
(Clinger-Cohen  DSMC,  2001). 

DoDD  5000  Series  Rewrites 


The  DoDD  5000  series  has  served  as  the  eomerstone  for  military  asset  aequisition 
sinee  the  1970s.  In  its  original  form,  the  5000  series  “mandated  a  complieated 
aequisition  proeess  requiring  the  government  to  follow  speeifie  rules.  The  5000  series 
also  eontained  supplemental  reeommendations  and  suggested  guidelines  and  other 
mandatory  rules  that  applied  only  in  eertain  eireumstanees.  The  proeess  was  very 
detailed  but  was  an  attempt  to  ensure  that  the  U.S.  Government  purehase  only  the  highest 
quality  equipment”  (DoD  Direetive  5000.1  and  5000. 2-R  Rewrite,  2001);  however, 
eontinued  efforts  towards  a  more  effieient  aequisition  system  elearly  identified  the  need 
to  revise  the  Series. 

In  1997,  the  first  drastieally  revised  DoDD  5000  series  was  released  to  realign 
aequisition  guidelines  with  eurrent  legislation.  The  rewrite  foeused  on  the  following  four 
streamlined  aequisition  proeesses. 
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•  It  incorporated  new  laws  and  policies. 

•  It  separated  mandatory  policies  and  proeedures  from  discretionary  praetices. 

•  It  reduced  the  volume  of  internal  regulatory  guidanee. 

•  It  integrated,  for  the  first  time  ever,  aequisition  polieies  and  proeedures  for 
both  weapon  systems  and  automated  information  systems  (DoD  Directive 
5000.1  and  DoD  5000.2-R  Rewrite,  DSMC,  2001). 

This  newly  revised  DoD  5000  series  was  dramatieally  simplified,  going  from  more  than 

1,000  pages  in  its  original  form  to  merely  160  pages  with  this  revision. 

In  2002,  the  DoD  5000  series  was  again  radieally  modified.  This  time  the  entire 
publication  was  suspended  from  use  until  a  more  flexible  guideline  could  be  ereated.  In  a 
Oetober  30,  2002  memorandum,  Underseeretary  of  Defense  Wolfowitz  canceled  the  DoD 
5000  Defense  Aequisition  Policy  Documents  stating  “I  have  determined  that  the  eurrent 
subject  documents  require  revision  to  ereate  an  aequisition  policy  environment  that 
fosters  effieiency,  flexibility,  ereativity,  and  innovation”  (Wolfowitz,  2002). 

A  new  DoD  5000  series  emerged  in  2003  to  satisfy  the  functional  criteria 
established  by  Undersecretary  Wolfowitz.  Sinee  the  2003  revision  exceeds  the  seope  of 
this  researeh,  the  details  will  not  be  diseussed  in  this  report. 

Summary 

Current  period  reform  initiatives  are  not  much  different  than  their  predeeessors,  as 
the  push  to  eliminate  bureaucraey  for  more  cost  effective  aequisition  seems  to  permeate 
from  deeade  to  deeade.  From  one  current  reform  initiative  to  another,  commonalities 
inelude  streamlining  regulatory  guidelines,  implementing  commereial  practices,  and 
providing  the  end-user  more  flexibility. 
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Cost  Growth  Studies 


This  section  summarizes  recent  research  studies  which  focus  on  quantifying  cost 
growth  in  DoD  acquisition  and  measuring  the  effectiveness  of  acquisition  reform 
initiatives.  These  studies  provide  the  motivation  and  methodology  for  this  research 

1993  Drezner  et  ah  Study 

The  Drezner  study  attempted  to  identify  the  extent  of  a  historical  cost  growth 
problem  in  DoD  acquisition  by  focusing  on  two  primary  research  objectives: 

•  Quantify  the  magnitude  of  cost  growth  in  weapon  systems. 

•  Identify  factors  affecting  cost  growth. 

Utilizing  the  Selected  Acquisition  Reports  (SAR)  as  of  December  1990,  a 
database  of  197  major  weapon  systems  was  compiled  for  cost  growth  analysis.  Two 
significant  findings  resulted  from  this  study.  First,  the  researchers  found  “no  substantial 
improvement  in  average  cost  growth  over  the  last  30  years,  despite  the  implementation  of 
several  initiatives  intended  to  mitigate  the  effects  of  cost  risk  and  the  associated  cost 
growth.  In  fact,  [their]  results  suggest  that  cost  growth  has  remained  about  20  percent 
over  this  time  period”  (Drezner  et  ah,  1993:xiv).  Second,  “researchers  could  not 
definitely  account  for  the  observed  cost  growth  patterns.  Thus,  no  ‘silver  bullet’  policy 
option  is  available  for  mitigating  cost  growth”  (Drezner  et  ah,  1993:xi);  however,  “the 
two  factors  that  have  the  greatest  effect  on  total  program  cost  growth  are  program  size 
and  maturity”  (Drezner  et  ah,  1993:xii). 

The  1993  Drezner  study  identified  troubling  results  about  cost  growth  in  the  DoD 
acquisition  process.  To  determine  if  the  cost  growth  pattern  continues  through  2001,  the 
RAND  study  is  utilized  as  the  guideline  for  this  thesis  research. 
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1999  Christensen  et  al.  Study 

Christensen’s  research  added  further  support  for  the  20  percent  average  annual 
cost  growth  identified  in  the  1993  Drezner  report,  finding  similar  results  with  the  Defense 
Acquisition  Executive  Summary  (DAES)  database  as  Drezner  found  with  the  SAR 
database  (Christensen  et  ah,  1999:251).  More  specifically,  this  study  analyzed  an  eight 
year  window  around  the  implementation  of  the  Packard  Commission’s  recommendations 
to  determine  if  cost  growth  improved  because  of  these  reform  efforts.  Christensen’s 
research  identified  that  the  Packard  Commission’s  recommendations  “did  not  reduce  the 
average  overrun  percent  experienced  on  269  completed  defense  acquisition  contracts  over 
an  eight  year  period  (1988  through  1995).  In  fact,  the  cost  performance  experienced  on 
development  contracts  and  on  contracts  managed  by  the  Air  Eorce  worsened  significantly 
(Christensen  et  al.,  1999:251).  Eailure  of  the  Packard  Commission’s  recommendations  to 
control  cost  growth  as  designed  reveals  the  need  for  continued  monitoring  of  newly 
implemented  acquisition  reform  efforts. 

2003  Holbrook  Thesis 

The  Holbrook  study  “focuses  on  the  timeline  of  current  reform  initiative 
implementation,  with  an  emphasis  on  cost  reduction-focused  initiatives.  This  study 
assesses  if  DoD  weapon  system  contract  cost  performance  is  improving  or  not  and  how 
any  cost  performance  trends  (positive  or  negative)  relate  to  the  implementation  timeline” 
(Holbrook,  2003:3).  The  use  of  the  DAES  database  enabled  Holbrook  to  apply  earned 
value  management  calculations  to  assess  cost  growth.  Although  Holbrook  used  a 
different  database  and  methodology  than  the  ones  applied  in  this  study,  his  research 
provides  a  unique  perspective  into  the  correlation  of  cost  growth  and  acquisition  reform. 
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Holbrook’s  thesis  is  based  on  two  specific  research  objectives. 

First,  “to  determine  if  a  mapping  between  cost  initiatives  and  cost  growth 
improvement  exists  and  if  so,  what  is  the  time  period  between  implementation  of 
an  initiative  and  the  results.  Second,  based  on  this  relationship  the  focus  will  be 
on  developing  a  model  or  ‘rule  of  thumb’  to  estimate  or  forecast  an  impact 
window  or  time  frame  in  which  to  expect  results  for  future  cost-related  acquisition 
reform  policies.  (Holbrook,  2003:4) 

His  research  focused  on  204  contracts  completed  between  January  1,  1994  and 
December  31,  2001  (Holbrook,  2003 :xi).  The  analysis  identified  that  cost  growth  was  no 
different  in  contracts  completed  after  acquisition  reform  implementation  than  it  was  in 
those  contracts  completed  before  acquisition  reform  implementation.  In  addition,  the 
research  investigated  cost  performance  on  all  active  contracts  from  1970  to  2002  with 
acquisition  reform  studies  and  commissions  over  the  same  time  period  to  examine  any 
trends  or  time  lags  between  reform  implementation  and  contract  cost  performance 
change.  The  study  results  “indicate  some  evidence  of  cost  performance  change  following 
the  different  studies  and  commissions”  (Holbrook  2003,  xi). 

Chapter  Summary 

This  chapter  defined  missile  system  programs  and  specified  their  relative  impact 
on  the  DoD  budget.  The  chapter  also  identified  the  long  history  of  acquisition  reform 
initiatives  up  to  2003,  revealing  the  legislative  impact  on  the  DoD  acquisition  process. 
Finally,  recent  cost  growth  studies  were  reviewed  to  establish  a  baseline  viewpoint  on  the 
extent  of  weapon  system  cost  growth  in  the  DoD. 

This  thesis  utilizes  the  past  cost  growth  studies  identified  above  to  identify  if  cost 
growth  is  still  plaguing  the  DoD  acquisition  process  today.  Hypothesizing  that  cost 


34 


growth  will  be  found  in  the  major  missile  programs  from  1991  to  2001,  further  analysis 
will  be  performed  to  identify  if  aequisition  reform  initiatives  have  made  any  impact  on 
reducing  the  amount  of  cost  growth  a  program  incurs.  The  methodology  for  this  research 
is  described  in  Chapter  III. 
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III.  Methodology 


Chapter  Overview 

Two  fundamental  questions  arise  when  performing  weapon  system  eost  growth 
analysis:  1)  how  to  aecurately  quantify  eost  growth  and  2)  whether  or  not  aequisition 
reform  initiatives  have  made  a  differenee  on  weapon  system  eost  growth.  The  issue  of 
eost  growth  ealculation  centers  on  what  adjustments  must  be  made  to  normalize  for 
inflation,  changes  in  baseline  quantities,  and  the  phenomenon  of  cost  improvements  with 
increasing  production  quantities.  To  determine  if  acquisition  reform  has  impacted  cost 
growth,  pre-reform  and  post-reform  periods  of  analysis  must  be  identified.  This  chapter 
explains  the  analysis  methods  used  in  this  research  effort,  describes  the  database  and  data 
used,  and  explains  the  phases  of  analysis  conducted. 

Data  Collection 

The  basic  source  of  information  in  this  cost  growth  analysis  is  from  Selected 
Acquisition  Reports  (SAR),  which  are  the  primary  documents  submitted  by  the 
Department  of  Defense  (DoD)  to  Congress  regarding  the  status  of  major  defense 
acquisition  programs  (MDAP)  (Jarvaise  et  ah,  1996:3).  To  minimize  interpretive  errors 
in  this  research,  data  was  extracted  from  the  Office  of  the  Secretary  of  Defense  (OSD) 
Cost  Analysis  Improvement  Group  (CAIG)  cost  growth  database.  The  OSD  CAIG 
database  compiles  all  historical  SAR  data  into  a  Microsoft  Excel  workbook,  while 
incorporating  expert  judgment  in  classifying  many  areas  that  are  reliant  on  interpretation, 
such  as  quantity-related  cost  variances.  This  electronic  database  not  only  facilitates 
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specific  program  data  extraction,  but  also  mitigates  some  SAR  limitations  discussed  in 
Chapter  I. 

MDAPs  reporting  SARs  are  acquisition  programs  that  are  “not  highly  sensitive 
classified  programs”  as  determined  by  the  Secretary  of  Defense  but  are: 

•  Designated  by  the  Secretary  of  Defense  as  an  MDAP,  or 

•  Estimated  by  the  Secretary  of  Defense  to  require  an  eventual  total  expenditure 
of  more  than  $300  million  (based  on  fiscal  year  1990  constant  dollars) 
research,  development,  test,  and  evaluation  (RDT&E)  or  an  eventual  total 
expenditure  for  procurement  of  more  than  $1.8  billion  (based  on  fiscal  year 
1990  constant  dollars)  (10  U.S.C.,  2430). 

SARs  are  developed  by  the  Program  Management  Offices  (PMOs)  and  provide 
data  on  the  cost,  schedule,  and  performance  status  of  MDAPs  at  regular  intervals 
(Jarvaise  et  ah,  1996:3).  Annual  SARs  are  mandatory  for  MDAPs  60  days  after  the  date 
on  which  the  President’s  Budget  is  submitted  to  Congress,  and  cover  data  as  of  3 1 
December.  Quarterly  SARs  are  reported  on  an  exception  basis  if  the  program  meets  the 
following  criteria: 

•  15%  or  more  increase  in  the  procurement  estimate  of  the  Program  Acquistion 
Unit  Cost  (PAUC)  compared  to  the  PAUC  in  the  currently  approved 
Acquisition  Program  Baseline  (APBA),  or 

•  15%  or  more  increase  in  the  current  estimate  of  the  Average  Procurement  Unit 
Cost  (APUC)  compared  to  the  APUC  in  the  currently  approved  APB,  or 

•  Six-month  of  greater  delay  in  the  current  estimate  of  any  schedule  milestone 
since  the  current  estimated  reported  in  the  previous  SAR,  or 

•  Milestone  B,  Milestone  C,  or  Pull  Rate  Production  Decision  Review 
(Milestones  II  or  III  for  grandfathered  programs)  and  associated  APB 
approval  within  90  days  prior  to  the  quarter  end  date  (DoD  5000.2-1). 

Data  used  in  this  study  is  from  the  1991  through  2001  annual  missile  system  SAR 
reports  and  is  current  as  of  December  2001.  The  schedule,  technical,  and  cost 
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information  listed  in  the  S  AR  is  reported  in  terms  of  “baseline,  approved  program,  and 
current  estimates”  (Jarvaise  et  al.,  1996:3).  For  the  purpose  of  this  research  the  sections 
on  program  acquisition  costs,  which  include  “all  such  costs  from  program  inception  to 
completion  regardless  of  the  program’s  stage  of  development”  (Hough,  1992:4),  are  of 
interest  and  used  in  the  data  collection  and  analysis. 

Two  estimates  of  cost  are  provided  in  a  SAR  and  are  allocated  to  the  following 
appropriations:  Development  (RDT&E),  procurement,  and  military  construction 
(MILCON).  The  first  cost  is  a  baseline  estimate  that  can  be  made  for  each  of  the  three 
Milestones:  Milestone  I  (A)  or  the  planning  estimate  (PE),  Milestone  II  (B)  or  the 
development  estimate  (DE),  and  Milestone  III  (C)  or  production  estimate  (PE)  (Hough, 
1992:4).  The  second  is  “the  current  estimate  that  includes  actual  schedule,  technical,  and 
cost  information  for  the  most  recent  estimate  available”  (Jarvaise  et  ah,  1996:3).  The 
costs  are  reported  in  both  base  year  (BY)  and  then  year  (TY)  dollars  millions.  The  DE, 
or  Milestone  II  (B)  estimate,  is  associated  with  the  Engineering  and  Manufacturing 
Development  (EMD)  start,  and  has  been  the  most  common  baseline  for  calculating  cost 
growth: 

Eor  many  types  of  descriptive  and  statistical  analyses,  cost  growth  is  referenced  to 
the  DE  baseline  since  prior  to  Milestone  2  (B),  capability  and  configuration  trade¬ 
offs  are  often  still  in  the  process  of  being  resolved.  Elsing  this  baseline  also 
establishes  a  weapon  system  of  reasonably  constant  scope  in  cost  growth 
analyses.  (Jarvaise  et  ah,  1996:  12) 

Therefore,  the  Milestone  II  (B)  estimate  is  used  as  the  baseline  in  this  research. 

Einally,  a  change  in  the  quantity  of  weapons  systems  from  baseline  to  current 
estimates  is  reported  each  year  in  the  program  acquisition  cost  section  of  the  SAR,  and 
identifies  the  quantity  of  weapons  systems  to  be  procured  for  the  given  estimate  as  well 
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as  the  baseline  estimate  (Hough,  1992:4).  Data  from  this  seetion  of  the  SAR  report  is 
used  when  making  quantity  normalization  adjustments  covered  in  the  Phase  I  section  of 
the  methodology. 

Phase  I 

Research  Objective 

Chapter  II  outlined  a  1993  RAND  report  that  measures  MDAP  cost  growth  from 
the  mid-1960s  to  1990  using  SARs.  The  research  revealed  that  the  average  cost  growth 
for  all  weapons  systems  was  around  20  percent,  while  missile  systems  averaged  1 7 
percent.  To  get  a  current  measure  of  the  state  of  missile  systems  cost  growth,  this  phase 
of  the  study  measures  cost  growth  using  missile  systems  SARs  from  1991  to  2001. 

Population  and  Sample 

The  data  population  for  this  research  encompasses  all  missile  systems  that 
reported  SARs  during  1991  to  2001.  The  sample  selected  from  this  population  for  Phase 
I  includes  only  those  programs  with  a  reported  Milestone  II  baseline.  A  total  of  21 
missile  system  programs  and  135  SARs  have  been  included  in  this  research. 

Data  Normalization 

Generally,  cost  growth  is  identified  as  the  change  between  the  baseline  estimate 
and  the  current  estimate.  There  are  two  primary  approaches  to  measuring  cost  growth: 
unadjusted  costs  and  adjusted  costs.  The  unadjusted  method  measures  cost  growth  in 
then-year  dollars  and  excludes  any  changes  in  procurement  quantity  or  inflation.  The 
unadjusted  procedure  is  used  when  measuring  the  impact  of  cost  growth  on  the  federal 
budget  and  is  favored  by  the  General  Accounting  Office  (GAO)  and  Congress  “because  it 
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reflects  the  budgetary  impact  of  all  program  cost  changes  regardless  of  what  conditions 
are  responsible  for  the  change”  (Hough,  1992;  10).  Adjusted  cost  growth  is  calculated  in 
constant  year  (CY)  dollars  to  eliminate  the  effects  of  inflation,  and  accounts  for  changes 
in  procurement  quantities.  The  adjusted  cost  growth  approach,  which  is  modified  and 
used  in  this  research,  is  preferred  when  “determining  how  well  program  management  has 
done  in  estimating  and  controlling  costs”  within  its  weapon  system  program  (Drezner  et 
ah,  1993:10).  The  adjusted  cost  growth  methodology  is  used  in  this  research. 

Inflation  Adjustment 

The  initial  step  in  adjusting  cost  data  using  SARs  is  to  remove  the  effects  of 
inflation,  which  are  outside  the  control  of  weapon  system  programs  and  serve  only  to 
disguise  the  true  level  of  cost  growth  when  left  unadjusted.  The  SAR  provides  data  in 
both  BY  and  TY  dollars,  so  the  effects  of  inflation  can  be  overcome  by  extracting  cost 
data  and  calculating  cost  growth  factors  in  BY  dollars  (Jarvaise  et  al,  1996:20). 

However,  a  common  occurrence  within  the  SARs  is  that  the  baseline  may  change  for  a 
particular  program.  Therefore,  to  perform  cost  growth  analysis  that  will  remain 
consistent  throughout,  all  data  calculations  must  be  adjusted  to  a  CY,  thus  eliminating  the 
effects  of  changing  baselines  and  inflation  by  removing  changes  in  the  value  of  money 
over  time  (Drezner  et  ah,  1993:21).  All  values  in  this  research  are  adjusted  by  applying 
the  OSD  CY  2000  inflation  indices,  and  shown  in  dollars  in  millions. 

Quantity  Adjustment 

After  the  inflation  adjustments  have  been  made  the  next  step  in  normalizing  the 
data  is  to  remove  the  effects  of  quantity  changes  from  the  baseline  estimate.  While 
adjusting  for  inflation  is  fairly  straightforward,  the  same  cannot  be  said  for  quantity 
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normalization;  it  is  critical  to  explain  exactly  how  the  ealculations  are  accomplished. 
General  steps  and  formulas  for  calculating  adjusted  cost  growth  are  provided  in  this 
chapter  along  with  adjusted  eost  growth  caleulations  using  the  Patriot  missile  SAR  data, 
as  of  December  2001,  to  illustrate  the  use  of  this  model  in  praetieal  context.  In  addition, 
all  missile  system  adjusted  cost  growth  and  learning  eurve  ealculations  are  provided  in 
Appendiees  A  to  V. 

Before  initial  adjustments  are  made,  it  must  first  be  decided  whether  to  reealeulate 
the  current  estimate  to  the  baseline  quantity  or  to  adjust  the  baseline  quantity  to  the 
current  quantity.  When  normalizing  to  the  current  quantity,  a  floating  baseline  is  created 
as  the  proeurement  quantity  changes,  whieh  can  lead  to  contrasting  measures  of  cost 
growth  when  there  are  large  ehanges  in  the  production  quantity.  On  the  other  hand, 
normalizing  to  the  baseline  quantity  will  “theoretieally  give  the  same  cost-growth  factor 
whether  subsequent  quantities  are  inereased  or  deereased”  (Hough,  1992:  30).  This 
method  is  approved  and  used  by  most  research  firms  conducting  cost  growth  analysis, 
and  is  therefore  adopted  for  this  study. 

Once  a  normalization  quantity  has  been  selected,  the  first  procedure  for  adjusting 
the  quantity  is  to  calculate  the  current  procurement  varianee  (CPV).  This  is 
accomplished  by  subtraeting  the  baseline  procurement  estimate  (BPROC)  from  the 
current  proeurement  estimate  (CPROC)  as  expressed  by  Equation  1  (Leonard,  2003). 

CPV  =  CPROC  -  BPROC  ( 1 ) 

Patriot  CPV  calculations  inflated  to  CY  2000  dollars  in  millions  from  1992  SAR: 
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4356.45  =  11963.64-7607.20 


The  second  step  is  to  calculate  the  current  and  cumulative  quantity-related  cost 
variances  associated  with  procurement  estimates  from  Section  13  of  the  SAR.  The 
Variances  in  “RDT&E  and  military  construction  are  not  normalized  because  they  are 
usually  (but  not  always)  independent  of  changes  in  the  procurement  quantity”  (Hough, 
1992:  33).  There  are  two  types  of  quantity  related  cost  variances  that  must  be  considered; 
primary  and  secondary. 

Primary  quantity-related  cost  variances  (PQRCV)  are  costs  increases  or  decreases 
that  are  directly  attributed  to  a  quantity  change,  and  are  identified  in  Section  13  of  the 
SAR  under  the  cost  variance  category  “Quantity.”  Secondary  quantity-related  cost 
variances  (SQRCV)  are  known  costs  effects  of  a  quantity  change,  such  as  an  increase  in 
initial  spare  parts  as  a  result  of  increase  in  procurement  quantity  that  are  not  directly 
related  with  the  end  item,  and  thus  not  reported  in  the  “Quantity”  category  (Hough,  1992: 
31).  The  secondary  quantity  effects  are  reported  under  the  schedule,  engineering,  and 
estimating  cost  variances  categories  and  can  be  subjectively  identified  as  resulting  from  a 
quantity  change  by  reading  the  current  variance  narrative  explanations  in  Section  13  of 
the  SAR.  The  SAR  database  provided  by  the  OSD  identified  the  secondary  quantity- 
related  variances  extracted  from  the  SAR  cost  variance  narratives,  and  this  thesis  makes 
use  of  those  values. 

Once  the  primary  and  secondary  quantity-related  variances  are  identified,  a  total 
quantity-related  cost  variance  (TQRCV)  is  calculated  by  summing  the  primary  and 
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secondary  quantity-related  variances  for  each  year  as  shown  in  Equation  2  (Leonard, 


2003). 


TQRCV  =  PQRCV  +  SQRCV  (2) 

Patriot  TQRCV  calculations  inflated  to  CY  2000  dollars  in  millions  from  1992 

SAR: 


0.00  =  0.00  +  0.00 


A  total  quantity-related  cumulative  cost  variance  (TQRCVcum)  must  then  be  calculated  by 
summing  the  TQRCV  for  all  previous  years  as  shown  in  Equation  3  (Leonard,  2003). 


TQRCVcum  =  Y.TQRCV,  (3) 
1 

i  =  the  ith  year  in  sample 
n  =  total  number  of  years  in  the  sample 


Patriot  TQRCVcum  calculations  inflated  to  CY  2000  dollars  in  millions  from  1992 

SAR: 


TQRCVcum  =  1913.42 

The  third  step  is  to  calculate  a  net  procurement,  or  residual  variance  (RV),  by 
subtracting  the  quantity-related  variance  from  the  total  procurement  variance.  The 
residual  variance  is  the  difference  between  the  baseline  estimate  and  current  estimate 
after  quantity-related  costs  are  removed.  In  essence,  residual  variance  is  non-quantity- 
related  cost  variance  and  is  expressed  by  Equation  4  (Leonard,  2003). 
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RV  =  CPV  -  TQRCVcum 


(4) 


Patriot  RV  calculations  inflated  to  CY  2000  dollars  in  millions  from  1992  SAR; 

2443.03  =  4356.45-  1913.42 

The  fourth  normalization  step  is  to  calculate  the  production  learning  curve  slope 
(LCS)  and  theoretical  first  unit  cost  (Tl).  These  calculations  are  performed  using  the 
cumulative  average  learning  curve  theory  methodology  for  lot  data.  Cumulative  average 
learning  curve  for  lot  data  generally  entails  applying  linear  regression  to  the  cumulative 
cost  of  producing  a  cumulative  number  of  units.  The  production  learning  curve  and  Tl 
are  created  from  the  regression  output.  The  LCS  is  “the  constant  factor  by  which  cost 
decreases  as  the  production  units  double  and  is  usually  expressed  as  a  percentage” 
(SCEA,  2002:6).  This  concept  is  shown  in  Figure  2. 


Quantity 


Figure  2,  Cumulative  Average  Learning  Curve  Slope  (McCrillis,  2003) 
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Normalizing  using  the  LCS  affects  the  data  by  either  increasing  or  decreasing  the 
amount  of  a  program’s  cost  variance.  A  weapon  system’s  baseline  cost  “is  established 
assuming  a  specific  quantity  of  units.  As  the  number  of  units  increases,  the  unit  cost  will 
go  down  even  though  the  program  cumulative  total  cost  increases.  As  the  number  of 
units  decreases,  the  unit  cost  increases  even  though  the  program  cumulative  total 
decreases”  (McCrillis,  2003).  This  concept  is  shown  in  Figure  3  for  a  notational  baseline 
program. 


-  Higher  UC  Program 

-  Baseline  Program 

-  Lower  UC  Program 


Figure  3,  Baseline  Program  Normalization  (McCrillis,  2003) 


The  lines  above  and  below  the  baseline  program  line  in  Figure  3  represent  programs  with 
positive  and  negative  cost  growth.  The  significance  of  adjustment  depends  on  the 
“percentage  of  quantity  change,  how  early  in  the  program  the  quantity  changed,  the 
direction  of  the  quantity  change,  and  the  steepness  of  the  slope”  (Hough,  1992:35). 
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To  assess  whether  a  program  has  experieneed  eost  growth  or  eost  reduetions,  the 
varianees  must  be  normalized  back  to  the  baseline  quantity.  The  basic  steps  for 
determining  a  LCS  are  listed  below. 

•  Gather  available  data  and  normalize  it  (e.g.,  convert  to  CY  dollars),  as 
necessary, 

•  Perform  any  necessary  operations  on  the  data  and  transform  into  log  space; 

•  Plot  the  data  to  determine  if  learning  curve  analysis  is  suitable  (should 
approximate  a  line  in  log  space); 

•  Determine  the  log-space  linear  equation,  generally  using  ordinary  least 
squares  (OLS)  regression; 

•  Transform  the  result  back  into  unit  space;  and 

•  Finally,  calculate  your  answers  (SCEA,  2002: 11). 

Data  required  for  developing  a  LCS  is  provided  in  the  procurement  breakout  of 
Section  16  (Program  Funding  Summary)  in  the  SAR.  This  section,  which  became 
regularly  available  beginning  with  the  December  1985  SAR,  displays  the  fiscal  year 
procurement  quantities  and  funding  numbers  for  both  completed  (i.e.,  “actual”)  and 
future  years  production.  In  some  cases,  limiting  the  LCS  calculations  to  completed 
production  years  will  result  in  an  insignificant  number  of  data  points.  Therefore,  the 
preferred  method  is  to  use  the  entire  procurement  breakout,  with  both  completed  and 
projected  production  cost  and  quantities,  which  will  produce  more  realistic  and  robust 
total  cost-quantity  curves.  In  addition,  when  developing  a  LCS  to  normalize  the  current 
estimate  to  the  baseline  quantity,  the  current  estimated  Program  Funding  Summary  data 
from  the  most  recent  SAR  should  be  applied  (Hough,  1992:  34). 
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Once  Program  Funding  Summary  data  has  been  assembled  from  Seetion  16  of  the 
SAR,  the  eumulative  average  unit  cost  (CAUC)  and  cumulative  units  produeed  (CUP) 
must  be  calculated  for  each  year.  The  CAUC  is  ealculated  by  summing  the  cost  of  all 
lots  up  to  and  including  the  current  one  and  then  dividing  by  the  CUP.  The  CAUC  and 
CUP  must  then  be  transformed  into  log  spaee  (SCEA,  2002:6). 

The  next  step  is  to  plot  the  log-spaee  data  using  a  scatter  plot  to  determine  if  the 
data  reasonably  approximates  a  straight  line.  The  In(CUP)  is  plotted  on  the  horizontal 
axis  and  the  In(CAUC)  on  the  vertical  axis  (SCEA,  2002:6).  Eor  normalizing  cost  growth 
data,  a  coefficient  of  determination  of  0.70  or  higher  is  generally  aecepted  (Hough, 
1992:39),  and  goodness  of  fit  regression  statisties  ean  be  used  to  determine  if  the  data  is 
statistieally  signifieant.  In  any  case  where  the  fit  does  not  meet  the  criteria,  the  average 
ECS  for  that  type  of  system  ean  be  used  (Hough,  1992:39). 

After  the  data  has  been  deemed  acceptable  for  eumulative  average  theory, 
ordinary  least  squares  (OES)  regression  can  determine  the  line  passing  through  the  log- 
spaee  data  points;  providing  the  y-intereept  and  slope  of  the  line.  This  operation  can 
easily  be  done  with  Microsoft  Excel  regression  analysis  and  most  statistieal  software 
packages.  The  y-intereept  and  slope  of  the  line  are  the  two  key  data  points  that  must  be 
transformed  back  to  unit  space  (SCEA,  2002:6). 

Transforming  the  y-intercept  back  to  unit  space  provides  the  Tl,  which  is  used  to 
best  fit  the  available  historieal  data.  Transformation  is  done  by  exponentiating  the  y- 
intercept  as  shown  in  Equation  5  (SCEA,  2002:16). 
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T1  =  (5) 

e  =  natural  log  base 
ln(a)  =  log-space  y-intercept 


To  arrive  at  the  LCS,  the  pereentage  by  whieh  eost  deereases  as  produetion  units  double, 
the  value  two  is  raised  to  the  log-spaee  slope  multiplied  by  the  natural  log  of  two  as 
expressed  in  Equation  6  (SCEA,  2002:16).  An  explanation  of  how  the  T1  and  ECS  are 
ineorporated  into  the  normalization  proeess  is  addressed  later  in  this  ehapter. 


ECS  = 


(6) 


e  =  natural  log  base 
b  =  log-space  slope 


Table  1 1  details  the  Patriot  missile  ECS  ealeulations  using  1992  SAR  (final 
program  SAR)  program  funding  summary  data  in  BY  1972  dollars  in  millions. 


Table  11.  Patriot  Missile  LCS  Calculations 


Lot# 

Cum 

Units 

Cum 

PROC 

BY$ 

CAUC 

Ln  Cum 

Units 

Ln 

(CUAC) 

Siope  (b) 

y- 

intercept 

(ina) 

T1 

Learn 

Curve 

1 

117 

241.50 

2.06 

4.76 

0.72 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

2 

247 

456.40 

1.85 

5.51 

0.61 

-0.15 

1.43 

4.18 

0.90 

3 

423 

740.50 

1.75 

6.05 

0.56 

-0.13 

1.34 

3.81 

0.91 

4 

710 

1042.10 

1.47 

6.57 

0.38 

-0.18 

1.59 

4.91 

0.88 

5 

1150 

1357.00 

1.18 

7.05 

0.17 

-0.23 

1.89 

6.64 

0.85 

6 

1590 

1683.30 

1.06 

7.37 

0.06 

-0.26 

2.04 

7.66 

0.83 

7 

2150 

1975.80 

0.92 

7.67 

-0.08 

-0.28 

2.17 

8.74 

0.82 

8 

2850 

2262.20 

0.79 

7.96 

-0.23 

-0.31 

2.30 

9.94 

0.81 

9 

3565 

2526.80 

0.71 

8.18 

-0.34 

-0.32 

2.40 

11.06 

0.80 

10 

4380 

2762.30 

0.63 

8.38 

-0.46 

-0.34 

2.50 

12.21 

0.79 

11 

5340 

2942.60 

0.55 

8.58 

-0.60 

-0.36 

2.61 

13.56 

0.78 

12 

6475 

3135.90 

0.48 

8.78 

-0.73 

-0.37 

2.71 

15.06 

0.77 

13 

6915 

3191.90 

0.46 

8.84 

-0.77 

-0.39 

2.79 

16.33 

0.76 
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The  calculations  above  result  in  a  TI  BY  cost  of  $16.33  and  a  learning  curve  slope 
of  0.76.  For  consistency,  the  theoretical  first  unit  cost  is  converted  to  CY  2000  dollars: 
CYTl  =$61.21. 

The  fifth  step  is  to  compute  the  theoretical  cost  of  the  baseline  quantity  (TCBQ) 
by  applying  the  production  learning  curve  and  the  Tl  values  as  expressed  by  Equation  7 
(Leonard,  2003).  This  equation  was  adopted  from  previous  RAND  research  on  cost 
growth  calculations  and  estimates  the  theoretic  cost  of  the  baseline  program  quantity 
given  the  current  production  learning  curve. 

TCBQ  =  BQ  *  Tl  *  BQ^(ln(LCS)/ln(2))  (7) 

Patriot  TCBQ  calculations  inflated  to  CY  2000  dollars  in  millions  from  1992 

SAR: 


1134.83  =  1 17*61.21*1 17^(ln(0.76)/ln(2)) 

The  sixth  step  is  to  compute  the  theoretical  cost  of  the  current  quantity  (TCCQ) 
by  applying  the  production  learning  curve  and  the  Tl  values  as  expressed  by  Equation  8 
(Leonard,  2003).  This  equation  was  adopted  from  previous  RAND  research  on  cost 
growth  calculations  and  estimates  the  theoretic  cost  of  the  current  program  quantity  given 
the  current  production  learning  curve. 

TCCQ  =  CQ  *  Tl  *  CQ^(ln(LCS)/ln(2))  (8) 
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Patriot  TCCQ  calculations  inflated  to  CY  2000  dollars  in  millions  from  1992 


SAR: 


13842.01  =  6915*61.21*6915^(ln(0.76)/ln(2)) 

The  final  step  is  to  identify  the  ealeulated  quantity-related  eost  varianee 
(CQRCV),  whieh  represents  the  theoretieal  value  of  eost  growth  relative  to  the  baseline 
estimate  at  the  baseline  quantity,  and  is  expressed  by  Equation  9  (Leonard,  2003). 

CQRCV  =  RV  *  TCBQ/TCCQ  (9) 

Patriot  CQRCV  ealeulations  inflated  to  CY  2000  dollars  in  millions  from  1992 

SAR: 


200.29  =  2443.03*1 134.83/13842.01 


Researeh  Variable 

Onee  the  normalization  adjustments  are  made  to  the  data,  the  researeh  variable, 
adjusted  eost  growth  factor  (ACGF),  can  be  ealeulated  for  each  SAR  year.  Adjusted  eost 
growth  ean  be  represented  in  many  ways:  dollars,  pereentage,  or  as  a  faetor.  This 
research  focuses  on  adjusted  eost  growth  as  a  faetor  of  the  baseline  estimate  and  is 
ealeulated  by  summing  the  eurrent  RDTE  estimate  (CRDTE),  the  BPROC  estimate  plus 
the  CQRCV,  and  the  current  MILCON  estimate  (CMILCON),  then  dividing  by  the  sum 
of  the  baseline  RDTE  (BRDTE),  BPROC,  and  the  baseline  MILCON  (BMILCON)  as 
shown  in  Equation  10  (Drezner  et  ah,  1993:12). 
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ACGF  =  (CRDTE  +  (BPROC  +  CQRCV)  +  CMILCON)/ 
(BRDTE  +  BPROC  +  BMILCON)  ( 1 0) 


Patriot  ACGF  calculations  inflated  to  CY  2000  dollars  in  millions  from  1992 

SAR; 


1.08  =  (5694.39  +  (7607.20  +  200.29)  +  206.34)/ 

(5063.03  +  7607.20  +  27.21) 

The  ACGF  calculations  are  performed  on  each  SAR  submission  for  all  programs 
in  the  researeh  sample,  thereby  identifying  annual  ACGFs  as  well  as  total  program 
ACGFs.  An  ACGF  greater  than  1.0  represents  a  program  that  incurred  cost  growth, 
while  an  ACGF  less  than  1.0  identifies  favorable  eost  performanee  within  a  program. 

Phase  I  Summary 

This  seetion  identified  the  Phase  I  researeh  objeetive  and  established  the  researeh 
population,  sample,  and  variable.  A  detailed  description  of  the  methodology  with 
equations  and  examples  for  data  normalization  to  adjust  for  inflation,  quantity  ehanges, 
and  cost  improvements  over  time  was  provided.  Finally,  an  explanation  for  quantifying 
adjusted  eost  growth  as  a  faetor  was  given. 
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Phase  II 


Research  Objective 

Chapter  II  identified  Department  of  Defense  acquisition  reform  attempts  from 
1991  to  2001  aimed  at  streamlining  the  procurement  process  and  reducing  weapon 
systems  cost  growth.  A  GAO  report  to  Congress  measuring  the  success  of  key  Federal 
Acquisition  Streamlining  ACT  (FAS  A)  initiatives  as  of  the  end  of  fiscal  year  1996, 
indicates  “that  the  organizations  [they]  reviewed  were  working  toward  achieving  key 
FASA  purposes,”  and  “to  reach  meaningful  conclusions  about  the  extent  of 
success. .  .additional  data  would  have  to  be  collected  and  examined  for  subsequent  fiscal 
years”  (GAO/NSIAD-98-81;3).  In  another  report  on  reform  status  in  a  1997  statement 
before  the  House  Committee  on  National  Security,  Under  Secretary  of  Defense  for 
Acquisition,  Technology,  and  Logistics  (USD,  AT&L)  Kaminski  stated:  “DoD  has 
achieved  a  large  measure  of  success  with  acquisition  reform,”  and  the  “Department  has 
made  a  number  of  critical  and  historical  changes  that  are  now  being  institutionalized  and 
beginning  to  bear  fruit”  (Kaminski,  1997).  Additionally,  a  1997  GAO  report  on  the 
effect  of  acquisition  reform  on  weapon  system  funding  identified  that  $7.2  billion  in  cost 
reductions  from  approved  budgets  were  expected  between  fiscal  year  1995  and  2002 
(GAO/NSIAD-98-31:2).  Considering  all  of  the  preceding  comments,  one  should  expect 
annual  cost  growth  to  decrease  over  time. 

The  second  objective  of  this  thesis  is  to  analyze  if  current  acquisition  reform 
initiatives  have  indeed  had  any  impact  on  missile  systems  cost  growth.  Thus,  a  cut-off 
treatment  date,  as  well  as  pre  and  post  reform  analysis  windows,  must  be  identified  for 
cost  growth  comparison.  The  broad  and  encompassing  policy  changes  of  1991  to  2001 
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naturally  occur  over  time,  and  it  is  “nearly  impossible  to  determine  a  precise  date  of 
implementation  for  the  aggregate  change”  (Searle,  1997:44).  As  a  result,  consistent  with 
the  Holbrook  and  Searle  studies,  this  date  is  judgmentally  selected  as  31  Deeember  1996 
(Holbrook,  2003:35;  Searle,  1997:45).  The  cut-off  treatment  date  for  this  study  is  chosen 
for  the  following  reasons: 

•  GAO  report  that  as  of  the  end  of  fiscal  year  1996  the  DoD  was  in  compliance 
with  FASA  and  that  additional  data  would  need  to  be  collected  and  examined 
for  subsequent  years; 

•  Passage  of  Clinger-Cohen  Act  of  1996; 

•  DoDD  5000  Series  revision  released  in  1997; 

•  Speech  by  USD,  AT&L  Kaminski  regarding  success  to  date  in  1997;  and 

•  GAO  report  estimating  $7.2  billion  reduction  in  budget  from  1995  to  2002 
due  to  the  effects  of  acquisition  reform  on  weapon  system  funding. 

This  cut-off  treatment  date  allows  for  six  years  of  pre-reform  and  five  years  of 
post  reform  SAR  data  in  the  study,  and  provides  enough  time  to  mitigate  bias  due  to 
faetors  such  as  fluctuations  in  the  defense  business  cycle  (Wandland  &  Wickman, 
1993:28).  Therefore,  this  study  will  use  various  statistical  techniques  to  test  missile 
systems  cost  growth  for  the  pre-reform  period  samples  (1  January  1991  to  31  December 
1996)  to  the  after  reform  period  samples  (1  January  1997  to  31  December  2001)  in  order 
to  make  inferences  about  the  difference  between  population  cost  growth  parameters  if 
one  exists. 

Population  and  Sample 

The  data  population  for  this  research  encompasses  all  missile  systems  that 
reported  SARs  during  1991  to  2001.  A  pre-reform  and  post-reform  sample  is  selected 
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from  this  population  for  Phase  II  analysis.  The  pre-reform  sample  ineludes  only  those 
programs  from  1991  to  1996  that  reported  a  Milestone  II  baseline  estimate.  A  total  of  20 
missile  systems  and  76  SARs  are  ineluded  in  the  pre-reform  sample.  Similarly,  the  post¬ 
reform  sample  includes  only  those  programs  from  1997  to  2001  that  reported  a  Milestone 
II  baseline  estimate.  A  total  of  13  missile  systems  and  59  SARs  are  included  in  the  post¬ 
reform  sample. 

Research  Variable 

This  study  analyzes  the  impact  of  acquisition  reform  on  cost  growth  and  utilizes 
the  mean  pre-reform  ACGFs  (mean  ACGFpre-reform)  and  the  mean  post  reform  ACGFs 
(mean  ACGFpost-reform)  as  the  research  variables.  Generating  these  two  research  variables 
requires  two  mathematical  steps.  First,  calculate  the  mean  annual  adjusted  cost  growth 
factor  (ACGF)  as  expressed  by  Equation  1 1 . 


ACGF,  = 


Y^ACGF, 

V  1  J 


/  n 


11 


i  =  the  ith  ACGF  in  sample  year  j 
n  =  total  number  of  programs  in  year  j 


Then  calculate  the  mean  ACGF  for  pre-reform  and  post-reform  samples  as  expressed  by 
Equations  12  and  13. 


ACGF. 


pre-reform 


Y^ACGF, 

V  1 


/  n 


12 


i  =  the  ith  year  in  sample 
n  =  total  number  of  years  in  sample 
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f  n 


ACGF. 


post-reform 


Y^ACGFi 

V  1 


/  n 


13 


i  =  the  ith  year  in  sample 
n  =  total  number  of  years  in  sample 


The  research  variables  mean  ACGFpre-reform  and  mean  ACGFpost-reform  are  then  analyzed  in 
a  hypothesis  test  to  determine  the  impact  of  acquisition  reform  on  cost  growth. 

Research  Question  and  Flypothesis 

Research  question;  Is  the  mean  ACGF  for  pre-reform  (1  January  1991  to  31 
December  1996)  missile  systems  different  than  the  mean  ACGF  for  post-reform  (1 
January  1997  to  31  December  2001)  missile  systems?  To  answer  this  question,  the 
following  hypothesis  is  tested: 

Hq.  mean  ACGFpre-reform  mean  ACGFpost-reform 

Ha-  mean  ACGF  pre-reform  ^  mean  ACGF  post-reform 
If  the  null  hypothesis  is  true,  then  there  is  no  statistical  difference  in  cost  growth  between 
the  pre  and  post  reform  periods.  This  would  indicate  that  current  acquisition  reform 
initiatives  did  not  statistically  impact  cost  growth.  If  the  alternate  hypothesis  is  true,  then 
there  is  a  statistical  difference  between  the  pre  and  post  reform  periods.  This  would 
indicate  that  current  acquisition  reform  initiatives  did  impact  cost  growth. 

Statistical  Analysis 

The  principal  analysis  used  in  Phase  II  involves  applying  statistical  tests  to 
determine  whether  significant  differences  exist  between  population  means.  The  first  step 
in  the  analysis  is  to  determine  if  the  required  assumptions  are  met  to  perform  either 
parametric  or  nonparametric  techniques.  Parametric  statistical  tests,  like  the  z-test  for 
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large  samples  (n  >  30)  and  t-test  for  small  independent  samples  (n  <  30),  involve  making 
inferenees  about  population  parameters  when  the  data  sampled  are  from  a  normally 
distributed  population.  Nonparametrie  tests,  like  the  Wileoxon  rank  sum  test  (a.k.a.  the 
Mann- Whitney  test)  for  making  inferenees  about  two  population  means  and  eommonly 
referred  to  as  distribution-free  tests,  do  not  require  the  data  to  be  normally  distributed 
(MeClave  et  al.,  2001:888). 

If  the  two  population  means  have  samples  where  (n  >  30)  the  z-test  ean  be  used 
sinee  the  Central  Limit  Theorem  states  that  “for  suffieiently  large  samples  the  sampling 
distribution  of  the  sample  mean  is  approximately  normal”  (MeClave  et  ah,  2001:273). 
However,  if  (n  <  30)  for  the  two  population  means  the  small  sample  t-test  must  be  used 
and  an  assessment  of  normality  must  be  eondueted  (MeClave  et  ah,  2001 :399).  Sinee  (n 
<  30)  for  the  data  in  this  researeh,  tests  to  determine  the  appropriateness  of  the  small 
sample  t-test  will  be  eondueted. 

The  small  sample  t-test  is  the  appropriate  parametrie  statistieal  test  for  eomparing 
two  populations  with  independent  sampling  and  small  sample  sizes  (Sheskin,  2000:247). 
In  order  to  use  the  parametrie  small  sample  t-test  several  assumptions  must  be  validated: 
both  sampled  populations  must  be  approximately  normally  distributed  with  equal 
population  varianees,  and  the  random  samples  must  be  seleeted  independently  of  eaeh 
other  (MeClave  et  ah,  2001:399).  If  the  assumptions  are  met  and  the  small  sample  t-test 
result  is  signifieant  we  ean  eonelude  with  eonfidenee  that  “there  is  a  high  likelihood  that 
the  samples  represent  populations  with  different  means”  (Sheskin,  2000:247). 

If  the  assumption  of  normality  is  violated  for  the  small  sample  t-test,  then  an 
analogous  nonparametrie  test  like  the  Wileoxon  rank  sum  test  ean  be  used  (MeClave  et 
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al.,  2001  ;895).  It  can  be  proven  “that  the  Wileoxon  rank  sum  test  and  the  Mann-Whitney 
U  test  are  equivalent”  (MeClave  et  ah,  2001:897),  and  “although  they  employ  different 
equations  and  different  tables,  the  two  versions  of  the  test  yield  eomparable  results 
(Sheskin,  2000:289).  There  are  a  number  of  assumptions  neeessary  for  the  validity  of  the 
Wileoxon  ran  sum  test:  the  two  samples  are  random  and  independent,  and  the  two 
probability  distributions  from  whieh  the  samples  are  drawn  are  eontinuous  (MeClave  et 
ah,  2001 :897).  The  Wileoxon  rank  sum  test  is  eonsidered  by  many  statistieians  to  be  the 
best  nonparametrie  method  used  to  test  the  hypothesis  that  the  probability  distributions 
assoeiated  with  two  populations  are  equivalent  (Gibbons,  1971:149). 

The  hypothesis  testing  applied  in  this  thesis  will  use  an  observed  signifieanee 
level  (alpha  value  [a])  of  .05.  The  appropriate  test  statistie  values  will  be  given,  and  will 
be  explained  using  p-values.  The  p-value  for  a  speeifie  statistieal  test  is  the  “probability 
(assuming  Ho  is  true)  of  observing  a  value  of  the  test  statistie  that  is  at  least  eontradietory 
to  the  null  hypothesis”  (MeClave  et  ah,  2001:354),  and  is  the  smallest  level  of 
signifieanee  at  whieh  the  null  hypothesis  would  be  rejeeted  (Devore,  2000:342).  If  the 
observed  p-value  is  less  than  the  alpha  level  (.05),  rejeet  the  null  hypothesis;  otherwise  do 
not  rejeet  the  null  hypothesis  (MeClave  et  al.  2001:  356).  Table  12  displays  the 
aeeeptanee  and  rejeetion  eriteria  for  the  tests  using  p-values. 

Table  12.  Hypothesis  Test  Decision  Table  (Holbrook,  2003:44) 

P-value  <  .05  ^  rejeet  Ho  at  level  .05 
P-value  >  .05  ^  do  not  rejeet  Hp  at  level  .05 
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Data  Preparation 

Prior  to  conducting  hypothesis  testing,  the  parametrie  and  nonparametrie  test 
assumptions  must  be  eompared.  Validation  of  the  small  sample  t-test  requires  that  the 
data  be  assessed  for  independenee,  randomness,  normality  and  eonstant  varianee.  If  the 
test  for  normality  or  eonstant  varianee  is  not  met,  the  nonparametrie  Wileoxon  rank  sum 
test  will  be  used.  Assumptions  for  both  the  parametrie  small  sample  t-test  and 
nonparametrie  Wileoxon  rank  sum  test  are  displayed  in  Table  13. 


Table  13.  Assumptions 


small  sample  t-test 

Wileoxon  rank  sum  test 

1.  All  samples  are  random  samples 
from  their  respective  populations. 

1.  All  samples  are  random  samples 
from  their  respective  populations. 

2.  All  samples  are  independently 
selected  from  their  respective 
populations. 

2.  All  samples  are  independently 
selected  from  their  respective 
populations. 

3.  Both  sampled  populations  have 
relative  frequency  distributions  that 
are  approximately  normal. 

3.  The  two  probability  distributions 
from  which  the  samples  are  drawn 
are  continuous. 

4.  The  population  variances  are 
equal. 

Independenee 

Independenee  of  the  data  was  assumed  based  on  the  following; 

•  Likeness  eaused  by  legislation  and  regulation  would  affeet  eost  performanee 
equally  aeross  all  DoD  programs;  and 

•  Multiple  systems  under  similar  program  managers  are  run  by  a  multitude  of 
eost  management  eontraetors  and  personnel  (Searle,  1997:58-59). 

The  eharaeteristies  of  the  population  data,  and  subsequent  sample  data  used  in  this  study, 

are  the  same.  All  DoD  missile  systems  are  managed  under  the  same  legislation  and 

regulations,  and  it  is  the  attempt  of  this  researeh  to  determine  if  these  ehanges  have 
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impacted  cost  growth  by  comparing  pre-reform  and  post-reform  periods.  Additionally, 
within  each  missile  program  there  are  numerous  groups  performing  cost  management  and 
estimating  tasks,  including  support  contractors,  financial  management  personnel,  and 
engineers,  all  with  varying  degrees  of  experience  and  training.  Therefore,  the  assumption 
of  independence  can  be  established.  Despite  all  of  the  variables  that  support  the 
assumption  of  independence  in  this  data,  it  is  important  to  acknowledge  the  possibility 
that  the  samples  may  not  be  independent;  thereby,  potentially  skewing  the  analysis 
results. 

Random  Sample 

A  random  sample  is  defined  as  one  which  “ensures  that  every  subset  of  fixed  size 
in  the  population  has  the  same  chance  of  being  included  in  the  sample”  (McClave  et  ah, 
2001:16).  Since  this  research  contains  the  entire  population  of  missile  systems  in  the 
SAR  database  from  1991  to  2001,  the  extracted  data  cannot  be  truly  random.  However, 
given  the  statistical  limitations  of  working  with  “real”  data  and  the  complete  utilization  of 
existing  population  data,  the  random  sample  requirement  is  assumed.  It  is  important  to 
note  that  failure  to  meet  the  random  sample  requirement  may  skew  analysis  results. 

Normality 

The  normality  requirement  will  be  tested  both  subjectively  and  objectively.  The 
subjective  analysis  consists  of  generating  normal  probability  plots,  which  provide  a 
graphical  display  of  the  data.  A  straight  line  would  indicate  the  potential  existence  of  a 
normal  distribution,  while  a  nonlinear  configuration  would  indicate  the  contrary 
(D’Agosto  and  Stephens,  1986:35).  This  graphical  representation  serves  only  as  an 


59 


informal  preliminary  judgment  of  normality  and  should  always  be  aeeompanied  by  a 
formal  normality  test  (D’Agosto  and  Stephens,  1986:41,  405). 

The  Shapiro-Wilks  test  for  normality  eonstitutes  the  formal  objeetive  test  and  is 
preferred  over  less  accurate  tests  such  as  the  chi  square  and  Kolmogorov-Smimov  tests. 
Overall,  the  Shapiro-Wilks  test  is  probably  the  most  powerful  non-graphical  test  of 
normality  (D’Agosto  and  Stephens,  1986:41,  406).  The  null  hypothesis  for  the  Shapiro 
Wilks  test  is  that  the  data  is  normally  distributed,  while  the  alternate  hypothesis  is  that  the 
data  is  not  normally  distributed  (D’Agosto  and  Stephens,  1986:41,  368).  The  resulting  p- 
value  from  this  test  indicates  the  significance  of  any  normality  violations  and  is  identified 
by  a  p-value  that  is  less  than  or  equal  to  the  established  alpha  level. 

Equality  of  Variance 

The  method  for  testing  homogeneity  of  variance  is  dependent  on  the  normality  of 
the  populations  being  analyzed;  assuming  independence  and  random  sample 
requirements  are  met.  If  the  populations  are  both  normally  distributed  then  the  F-Test  for 
equal  population  variances  would  be  employed.  The  F-Test  uses  the  ratio  of  population 
variances  as  the  test  statistic  to  assess  if  there  is  equal  variance  between  the  populations 
(McClave  et  ah,  2001:435-436).  If  the  F-Test  reveals  equality  of  variance  and  all  other 
assumptions  are  met,  the  parametric  small  sample  t-test  using  a  pooled  sample  estimator 
of  the  variance  can  be  used. 

If  a  population’s  Shapiro  Wilks  test  revels  that  the  data  is  non-normally 
distributed,  which  past  cost  growth  research  has  indicated  (Christensen  and  Templin, 
2002:108),  then  the  Fevene  Test  for  homogeneity  of  variance  will  be  used  because  it  is 
less  sensitive  to  violations  of  normality  (Neter  et  ah, 1996:1 12).  While  the  assumption  of 
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equality  of  variance  is  not  required  when  performing  the  nonparametric  Wilcoxon  rank 
sum  test,  the  results  of  the  Levene  Test  for  homogeneity  of  variance  can  provide  a 
general  description  about  the  data’s  consistency. 

Phase  II  Summary 

This  section  identified  the  Phase  II  research  objective  and  detailed  the 
methodology  utilized  to  determine  if  acquisition  reform  initiatives  have  made  an  impact 
on  missile  system  cost  growth.  The  hypothesis  testing  treatment  methods  were  defined, 
and  the  assumptions  necessary  for  appropriate  model  selection,  either  the  parametric  two 
sample  t-test  or  nonparametric  Wilcoxon  rank  sum  test,  was  discussed. 

Chapter  Summary 

This  chapter  detailed  the  methodology  utilized  to  conduct  each  phase  of  the 
analysis.  Phase  I  focused  on  generating  ACGFs  for  each  missile  program  for  all  relevant 
years  in  the  research  window.  Subsequently,  Phase  II  utilized  the  adjusted  cost  growth 
factors  from  Phase  I  to  test  if  current  acquisition  reform  initiatives  made  any  impact  on 
missile  program’s  cost  growth.  Results  of  these  analyses  are  provided  in  Chapter  IV. 
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IV,  Results 


Chapter  Overview 

This  chapter  presents  the  results  of  the  statistieal  analysis  for  eaeh  phase  of  the 
researeh.  An  analytieal  summary  of  the  statistieal  test  results  are  presented  as  either 
tabular  or  graphical  images  for  each  individual  phase. 

Phase  I 

The  purpose  of  Phase  I  was  to  ealeulate  adjusted  missile  system  cost  growth 
factors  from  the  1991  to  2001  Seleeted  Aequisition  Reports  (SAR),  using  a  hybrid 
adjusted  eost  growth  model.  The  data  population  for  this  research  contains  all  missile 
programs  that  reported  SARs  during  1991  to  2001.  The  sample  seleeted  for  Phase  I 
includes  only  those  programs  with  a  reported  Milestone  II  baseline.  A  total  of  21  missile 
systems  and  135  reported  SARs  were  identified  for  this  treatment  period.  The  adjusted 
eost  growth  factors  (ACGF)  for  each  program  are  presented  in  Table  14. 
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Table  14,  Annual  Adjusted  Cost  Growth  Factors 


Program 

1991 

1992 

1993 

1994 

1995 

1996 

1997 

1998 

1999 

gJiTin 

2001 

AGM-65D  (Maverick) 

1.85 

1.86 

■ 

AGM-84A  (Harpoon) 

1.62 

Hi 

AGM-88  (HARM  USN) 

1.46 

1.46 

IQ 

AGM-114(Hellfire) 

1.57 

1.59 

IQ 

AGM-1 14K  (Hellfire  Longbow) 

1.01 

1.44 

1.06 

1.14 

1.16 

1.17 

1.16 

1.17 

1.17 

1.21 

AIM-9X  (Sidewinder) 

1.00 

1.00 

1.00 

1.00 

AiM-54C  (Phoenix) 

0.37 

AiM-120  (AMRAAM) 

1.55 

1.84 

1.77 

1.80 

1.77 

1.70 

1.70 

1.70 

1.70 

1.70 

ATACMS  P3i  (BAT) 

1.00 

1.13 

1.18 

1.28 

Ik 

1.28 

1.37 

1.58 

1.95 

2.12 

2.25 

BLU-108  JSOW  AiWS 

1.00 

1.03 

0.99 

HR 

1.08 

1.08 

1.06 

1.07 

1.07 

1.27 

BLU-108  JSOW  Unitary 

HR  1 

1.09 

1.10 

1.33 

1.20 

1.20 

1.60 

CBU-97B  SFW 

1.09 

1.08 

1.02 

1.05 

1.16 

1.23 

1.24 

1.19 

FGM-148A  Javeline  AAWS 

1.14 

1.40 

1.78 

1.62 

1.65 

1.72 

1.79 

1.98 

2.05 

2.15 

2.11 

JDAM 

1.00 

0.99 

1.02 

1.09 

1.11 

1.11 

1.17 

MiM-104  Patriot 

1.08 

1.08 

MiM-104  Patriot  PAC3 

1.00 

1.04 

1.26 

1.63 

1.58 

1.27 

1.43 

Navy  Area  TBMD 

IH 

1.11 

1.14 

1.14 

1.48 

RiM-66M/67D  (SM-2  MR/ER) 

0.98 

1.04 

1.05 

1.04 

1.08 

1.05 

1.07 

1.08 

1.09 

1.09 

1.13 

RGM-109  Tomahawk  MMM 

0.76 

0.83 

0.83 

0.78 

0.78 

0.78 

SADARM  155mm  Projectile 

1.02 

1.04 

1.15 

1.35 

1.46 

1.47 

1.62 

1.71 

SADARM  155mm  Rocket 

0.74 

0.92 

0.73 

Annual  Average 

1.15 

1.26 

1.24 

1.20 

1.20 

1.22 

1.26 

1.35 

1.37 

1.36 

1.49 

The  sampling  distribution  of  the  data  set  in  Table  14  is  eomprised  of  the  21  missile 
system  ACGFs,  whieh  ereate  the  population  distributions  for  the  eleven  annual  means, 
and  henee  the  random  variable  under  study  in  Phase  II. 

One  of  the  researeh  objeetives  of  this  thesis  is  to  eompare  the  1993  RAND  eost 
growth  analysis  results  for  missile  systems,  whieh  eovered  the  late  1960s  to  1990  and 
averaged  17  pereent,  to  that  of  missile  systems  for  the  eurrent  researeh  treatment  period 
of  1991  to  2001.  Averaging  all  eurrent  missile  system  ACGFs  produeed  an  overall 
average  for  the  treatment  period  of  28  pereent;  whieh  is  1 1  pereentage  points  higher  than 
the  historieal  RAND  results  of  17  pereent. 
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Phase  II 


The  objective  of  Phase  II  was  to  determine  if  current  acquisition  reform  initiatives 
have  impacted  the  mean  annual  ACGF  for  missile  systems.  The  mean  annual  ACGF  for 
each  year  is  depicted  in  Figure  4. 


Figure  4,  Average  Annual  Adjusted  Cost  Growth  Factors 

The  objective  in  Phase  II  was  accomplished  by  performing  a  hypothesis  test 
between  the  mean  ACGF  of  the  pre-reform  period  (1  January  to  31  December  1996)  to 
the  mean  ACGF  of  the  post-reform  period  (1  January  1997  to  3 1  December  2001).  Table 
1 5  provides  statistics  on  the  missile  systems  available  from  S ARs  during  the  treatment 
periods  that  meet  all  requirements  listed  for  this  research. 
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Table  15.  Sample  Statistics 


Group 

Pre-Reform 

Post-Reform 

(1  Jan  91  -  31  Dec  96) 

(1  Jan  97-31  Dec  01) 

#  Programs 

20 

13 

#SARS 

76 

59 

Sample  Mean 

1.23 

1.37 

Sample  Std  Dev 

0.04 

0.08 

The  pre-reform  ACGF  mean  of  1 .23  is  less  than  the  post-reform  ACGF  mean  of 
1.37;  however,  the  statistieal  signifieanee  of  this  differenee  must  be  determined  with  a 
hypothesis  test.  In  order  to  aeeurately  assess  whether  a  parametrie  or  nonparametrie 
hypothesis  test  is  appropriate,  the  assumptions  of  normality  and  equality  of  varianee  are 
tested  using  a  statistieal  software  paekage,  IMP  5.  The  assumption  test  outputs  and 
eorresponding  p-values  are  provided.  The  assumptions  of  independenee  and  randomness 
were  assumed  as  stated  in  Chapter  III,  therefore  no  formal  tests  are  eondueted. 

Normality 

Normality  of  the  six  pre-reform  means  and  five  post-reform  means  was  tested 
both  subjeetively  and  objeetively.  The  subjeetive  test  eonsisted  of  generating  normal 
probability  plots  for  both  the  pre-reform  and  post-reform  samples  as  shown  in  Figure  5. 
Sinee  the  data  points  from  eaeh  sample  form  a  relatively  straight  line,  it  is  likely  that  the 
samples  are  normal.  This  is  to  be  expeeted  sinee  the  sampling  distribution  of  76  pre¬ 
reform  and  59  post  reform  ACGFs  are  large  enough  to  approximate  a  normal  distribution 
of  the  pre-reform  and  post-reform  sample  means. 
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Pre-Reform  Normality  Post-Reform  Normality 


Normal  Quantile  Plot  Normal  Quantile  Plot 


Figure  5,  Normal  Probability  Plots 


The  objective  test  consisted  of  using  the  Shapiro  Wilks  Test  for  Normality  and  the 
test  results  are  displayed  in  Figure  6. 


Goodness-of-Fit  Test 

Shapiro-Wilk  W  Test 

W  Prob<W 
0.972794  0.9040 


Goodness-of-Fit  Test 

Shapiro-Wilk  W  Test 

W  Prob<W 
0.911866  0.4806 


Figure  6,  Sbapiro-Wilks  Test  Results 

The  p-value  in  the  pre-reform  sample  of  0.9040  and  post-reform  sample  of  0.4806 
exceed  the  established  alpha  level  of  0.05  and  indicate  that  the  pre-reform  and  post¬ 
reform  samples  originate  from  normal  distributions.  Since  the  parametric  small  sample  t- 
test  assumption  of  normality  is  validated,  the  F-test  for  equal  population  variances  is 
employed  to  check  the  equality  of  variance  assumption. 
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Equality  of  Variance 

The  F-test  for  equal  population  varianees  ean  be  eondueted  on  the  sample  data  set 
since  the  assumptions  that  the  two  populations  are  normally  distributed  and  randomly  and 
independently  selected  from  their  populations,  have  been  satisfied  (McClave  et  ah, 
2001:436).  The  F-test  compares  the  population  variances  by  making  inferences  about  the 
ratio  of  the  sample  variances.  An  F-test  for  equality  of  variance  was  conducted  using 
IMP  5.1.  The  F-test  results  are  displayed  in  Figure  7. 


Tests  that  the  Variances  are  Equal 

Level  Count  Std  Dev  MeanAbsDif  to  Mean  MeanAbsDif  to  Median 

1  6  0.0397382  0.0296282  0.0296282 

2  5  0.0791313  0.0478332  0.0479152 

Test  F  Ratio  DFNum  DFDen  Prob  >  F 

F  Test  2-sided  3.9653  4  5  0.1632 

Figure  7,  JMP  5,1  F-Test  Results 

Since  the  F  test  2-sided  p-value  of  0.1632  exceeds  the  established  alpha  level  of 
0.05,  the  equality  of  variance  assumption  is  satisfied  and  the  data  appears  stationary.  The 
parametric  small  sample  t-test,  with  a  pooled  sample  estimator  of  the  variance,  can  now 
be  conducted  to  compare  the  pre-reform  and  post-reform  means. 

Hypothesis  Test  Results 

The  small  sample  t-test  is  an  inferential  statistical  test  employed  to  evaluate 
whether  the  two  independent  samples  represent  two  populations  with  different  mean 
values  (Sheskin,  2000:247).  The  small  sample  t-test  used  in  this  research  to  determine  if 
pre-reform  and  post-reform  ACGF  means  are  the  equivalent,  is  a  non-directional  two- 
tailed  test.  If  the  test  results  are  significant,  one  can  conclude  that  there  is  a  high 
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likelihood  that  the  two  sample  means  are  different.  The  small  sample  t-test  JMP  5.1 
results  are  displayed  in  Figure  8. 


t  Test 


1-2 

Assuming  unequal  variances 


Difference  -0.15504  t  Ratio  -3.98265 

Std  Err  Dif  0.03893  DF  5.657985 

Upper  CL  Dif  -0.05837  Prob  >  |t|  0.0082 

Lower  CL  Dif  -0.25172  Prob  >  t  0.9959 


Confidence  0.95  Prob  <  t  0.0041  -0.20 


-0.10  .00  .05  .10  .15  .20 


Figure  8,  JMP  5,1  Small  Sample  T-Test  Results 


Since  the  t-test  p-value  of  0.0082  is  less  than  established  alpha  of  0.05,  there  is 
sufficient  evidence  to  reject  the  null  hypothesis.  Therefore,  the  t-test  results  provide 
statistical  support,  in  general,  to  reject  the  null  hypothesis  that  the  pre-reform  and  post¬ 
reform  samples  represent  two  populations  with  equal  annual  ACGF  means.  Further 
analysis  of  the  JMP  5.1  output  reveals  a  95  percent  confidence  interval  that  the  true 
difference  in  population  means  falls  within  the  lower  bounds  of  -0.25172  and  the  upper 
bounds  of  -0.05837.  Since  this  range  excludes  zero,  there  is  a  95  percent  probability  that 
the  two  populations  actually  have  different  means. 

Chapter  Summary 

This  chapter  presented  the  results  of  the  statistical  analysis  for  each  phase  of  the 
research.  Initially,  the  Phase  I  annual  ACGF  for  each  missile  system  were  identified  for 
years  1991  to  2001.  The  treatment  period  ACGF  average  of  28  percent  was  calculated 
and  shown  to  be  1 1  percentage  points  higher  than  the  30-year  historical  average  of  17 
percent  reported  by  RAND. 
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Next,  a  Phase  II  hypothesis  test  was  ehosen  to  determine  if  the  mean  ACGF  for 
pre-reform  (I  January  1991  to  31  Deeember  1996)  missile  systems  was  equal  to  the  mean 
ACGF  for  post-reform  (1  January  1997  to  31  Deeember  2001)  missile  systems.  The 
parametrie  small  sample  t-test  was  ehosen  as  the  hypothesis  test  after  the  Shapiro-Wilks 
test  for  normality  indieated  that  the  sample  distributions  were  normal  and  the  F-test 
revealed  equality  of  varianee.  Finally,  the  Phase  II  small  sample  t-test  hypothesis  results 
were  presented,  identifying  signifieant  statistieal  disparity  between  the  means  of  eaeh 
reform  period. 
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V,  Conclusion 


Review  of  Research  Objectives 

This  research  focused  on  two  main  objectives.  First,  using  a  hybrid  adjusted  cost 
growth  model  determine  if  missile  programs  incurred  cost  growth  from  1991  to  2001  at  a 
similar  rate  to  missile  system  cost  growth  identified  in  the  previous  30  years  by  RAND. 
Second,  through  statistical  hypothesis  testing  identify  if  acquisition  reform  initiatives 
implemented  during  the  research  window  made  any  impact  on  missile  program  cost 
growth. 

Discussion  of  Results 

The  Phase  I  adjusted  cost  growth  factor  (ACGF)  results  revealed  that  from  1991 
to  2001  missile  system  programs  have  on  average  exceeded  the  17  percent  historical 
ACGF  identified  by  RAND.  This  result  is  apparent  when  averaging  all  of  the  annual 
ACGFs  from  Table  14.  Additionally,  the  results  identified  that  18  of  21  (85.71  percent) 
missile  systems  included  in  this  analysis  experienced  cost  growth  from  1991  to  2001. 

The  Phase  11  statistical  assumptions  of  independence,  random  sampling, 
normality,  and  equality  of  variance  were  validated  to  determine  the  appropriate 
hypothesis  test  for  this  analysis.  While  independence  and  random  sampling  were 
assumed,  the  normality  and  equality  of  variance  assumptions  passed  the  appropriate 
statistical  tests,  identifying  the  need  for  a  parametric  hypothesis  test.  The  small  sample  t- 
test  was  chosen  for  this  analysis  because  it  is  the  appropriate  statistical  test  for  comparing 
two  populations  with  independent  sampling  and  small  sample  sizes. 
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The  small  sample  t-test  results  provide  statistieal  support,  in  general,  to  rejeet  the 
null  hypothesis  that  the  pre-reform  samples  and  the  post-reform  samples  represent  two 
populations  with  equal  annual  ACGF  means.  This  result  reveals  that  average  annual 
adjusted  eost  growth  in  the  pre-reform  and  post-reform  periods  are  not  the  same.  In  faet, 
the  average  annual  ACGF  is  only  1.23  before  the  1996  treatment  date,  while  the  average 
annual  ACGF  inereases  to  1.37  after  the  treatment  date.  This  inerease  in  average  annual 
ACGF  suggests  that  eurrent  aequisition  reform  initiatives  have  not  redueed  the  amount  of 
eost  growth  experieneed  by  missile  system  programs.  Although  this  analysis  does  not 
suggest  that  aequisition  reform  initiatives  have  eaused  the  inereased  average  annual 
ACGFs,  the  data  does  reveal  a  distinet  inerease  in  missile  system  eost  growth  during  this 
researeh  period. 

Conclusions 

The  Phase  I  results  identified  that  adjusted  eost  growth  existed  in  18  of  21  missile 
programs.  These  results  effeetively  satisfied  the  initial  researeh  objeetive  of  determining 
if  adjusted  eost  growth  existed  in  missile  systems  during  the  researeh  period  and  formed 
the  ACGFs  for  the  Phase  II  analysis.  The  Phase  I  analysis  revealed  several  eomplieating 
faetors  involved  in  performing  eost  growth  ealeulations.  Initially,  the  data  ineluded  in 
eost  growth  ealeulations  are  somewhat  subjeetive,  as  one  must  earefully  interpret  the 
Seleeted  Aequisition  Report’s  (SAR)  qualitative  and  quantitative  seetions.  Proper  data 
extraetion  from  the  SAR  is  perhaps  best  elassified  as  an  art  rather  than  a  seienee,  as 
numerous  organizations  have  developed  different  eost  data  from  the  same  souree 
doeuments.  Furthermore,  there  are  several  different  methodologies  available  to  ealeulate 
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cost  growth.  Researchers  must  elearly  determine  how  to  adjust  for  inflation  and  whether 
or  not  to  aeeount  for  quantity  adjustments,  produetion  learning  eurves  or  simply  eompute 
the  raw  data  at  faee  value.  Seleeting  the  appropriate  methodology  for  the  researeh 
objeetive  is  erueial  in  generating  aeeurate  results.  Finally,  the  dynamie  nature  of  using 
“real  world”  data  poses  several  statistieal  limitations  as  new  missile  systems  begin  and 
existing  systems  terminate  throughout  the  researeh  period.  However,  statistieal 
limitations  are  eommon  and  generally  aeeepted  when  dealing  with  “real  world”  data. 

The  results  of  Phase  II  identified  that  adjusted  eost  growth  in  missile  systems  has 
inereased  despite  numerous  aequisition  reform  initiatives  to  eurb  sueh  growth.  This 
result  raises  some  eoneerns  about  the  effeetiveness  of  eurrent  aequisition  reform 
strategies  on  weapon  system  eost  growth.  As  revealed  in  Chapter  II,  many  of  the  same 
reform  initiatives  re-appear  with  eaeh  attempt  to  eurb  eost  growth,  even  after  historieal 
eost  growth  studies  revealed  that  eost  growth  within  major  defense  aequisition  programs 
eontinue  to  average  around  20  pereent.  Many  of  the  themes  that  have  persisted  in  both 
historieal  and  eurrent  aequisition  reform  endeavors  inelude;  a  push  to  eliminate 
bureaueraey,  streamlining  regulatory  guidelines,  implementing  eommereial  praetiees, 
providing  the  end-user  more  flexibility,  and  organizational  eulture  ehange.  While  the 
majority  of  the  Department  of  Defense,  Congressional,  and  Presidential  Administration’s 
aequisition  reform  efforts  have  targeted  some  form  of  management  ineffieieneies,  the 
results  of  this  and  previous  eost  growth  studies  eertainly  leave  room  for  debate  as  to 
whether  this  approaeh  is  appropriate  for  redueing  eost  growth. 
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Recommendations  for  Future  Research 


During  the  course  of  this  thesis,  three  potential  areas  for  follow-on  research  arose. 
First,  analyze  recent  cost  growth  for  all  weapon  systems  using  SAR  data.  Results  from 
this  analysis  could  be  compared  with  RAND’s  historical  cost  growth  results  to  determine 
if,  on  a  macro  level,  any  improvements  have  occurred  over  time.  Additionally,  testing  for 
differences  in  the  pre-reform  and  post-reform  population  means  of  all  weapon  systems 
may  reveal  that  the  missile  system  results  in  this  thesis  were  simply  an  anomaly  and 
acquisition  reform  initiatives  have  made  cost  growth  improvements.  Second,  identify  the 
causes  of  cost  growth  at  the  program  level  and  quantify  the  most  severe  cost  growth 
drivers.  Due  to  the  dynamic  nature  of  weapon  system  acquisition,  identifying  cost 
drivers  that  universally  apply  to  all  programs  may  not  provide  a  specific  program 
manager  with  much  insight.  Flowever,  research  performed  to  identify  and  quantitatively 
rank  the  most  significant  program  specific  cost  drivers  would  reveal  where  the  greatest 
cost  growth  mitigation  efforts  should  be  focused.  Finally,  develop  a  program  specific 
cost  growth  model  to  facilitate  cost  growth  management  in  the  future.  Numerous 
researchers  have  designed  generic  cost  growth  prediction  models  applicable  to  all 
weapon  systems;  however,  designing  a  cost  growth  prediction  model  for  a  specific 
program  may  provide  more  relevant  results  for  the  respective  program  manager.  A  more 
specialized  cost  growth  model  for  a  single  weapon  system  should  effectively  account  for 
the  nuances  of  that  system  and  generate  a  more  accurate  cost  growth  forecast.  This 
improvement  in  cost  growth  forecasting  accuracy  would  enable  a  program  manager  to 
devise  a  more  appropriate  scheme  for  mitigating  cost  growth. 
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Appendix  A,  AGM-65G  (Maverick)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

SAR 

YEAR 

MSII 

Baseline 

Year 

MSII 

Baseline 

Qty 

MSII 

Baseline 

RDTE$ 

MSII 

Baseline 
PROC  $ 

MSII 

Baseline 
MCON  $ 

MSII 

Baseline 
Total  $ 

1991 

1992 

1976 

1976 

271.35 

271.35 

2603.17 

2603.17 

0.00 

0.00 

2874.52 

2874.52 

Current  Data 

SAR 

YEAR 

MSII 

Current 

RDTE$ 

MSN 

Current 
PROC  $ 

MSII 

Current 
MCON  $ 

MSII 
Current 
Total  $ 

Current 
PROC  Qty 

1991 

1992 

305.73 

305.73 

3462.28 

3410.04 

3768.01 

3715.77 

25514.00 

24914.00 

Quantity  Variance  Data 

SAR 

YEAR 

Current 
PROC  Var 

Direct  Qty 
Var 

Indirect 
Qty  Var 

Total  Qty 
Var 

Cum  Total 
Qty  Var 

Residual 

Var 

1991 

1992 

859.11 

806.87 

629.29 

-42.27 

322.86 

-51.96 

-1307.31 

-1359.27 

2166.42 

2166.14 

Learning  Curve  Analysis 

SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

1992 

17.42  0.72  3793.24  3423.14  2400.65 

17.42  0.72  3793.24  3381.01  2430.25 

Cost  Growth  Factors 

SAR 

YEAR 

RDTE 

CGF 

UNADJ 

PROC 

CGF 

ADJ 

PROC 

CGF 

MCON 

CGF 

UNADJ 

TOTAL 

CGF 

ADJ 

TOTAL 

CGF 

1991 

1992 

1.92 

1.93 

#DIV/0! 

#DIV/0! 

1.31 

1.29 

1.85 

1.86 

74 


Appendix  B,  AGM-84A  (Harpoon)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

SAR 

YEAR 

MSII 

Baseline 

Year 

MSII 

Baseline 

Qty 

MSII 

Baseline 

RDTE$ 

MSII 

Baseline 

PROC$ 

MSII 

Baseline 
MCON  $ 

MSII 

Baseline 
Total  $ 

1991 

1973 

2870 

1089.03 

2188.81 

0.00 

3277.85 

Current  Data 

SAR 

YEAR 

MSII 

Current 

RDTE$ 

MSII 
Current 
PROC  $ 

MSII 
Current 
MCON  $ 

MSII 
Current 
Total  $ 

Current 
PROC  Qty 

1991  1139.62 

5253.99 

1.17 

6394.79 

3653 

Quantity  Variance  Data 

SAR 

YEAR 

Current 
PROC  Var 

Direct  Qty 
Var 

Indirect  Qty 
Var 

Total  Qty 
Var 

Cum  Total 
Qty  Var 

Residual 

Var 

1991 

3065.18 

5.89 

0.00 

5.89 

646.34 

2418.84 

Learning  Curve  Analysis 

SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

4.59 

0.90 

3926.74 

4818.22 

1971.30 

Cost  Growth  Factors 

SAR 

YEAR 

RDTE 

CGF 

UNADJ 

PROC 

CGF 

ADJ  PROC 
CGF 

MCON  CGF 

UNADJ 

TOTAL 

CGF 

ADJ 

TOTAL 

CGF 

1991 

1.05 

2.40 

1.90 

#DIV/0! 

1.95 

1.62 
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Appendix  C.  AGM-88  (HARM  USN)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSN 

MSN 

MSN 

MSN 

MSN 

MSN 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PROC  $ 

MCON  $ 

Total  $ 

1978 

1679.98 

0.00 

2195.32 

mmm 

1978 

1679.98 

0.00 

2195.32 

1978 

6467 

515.34 

1679.98 

0.00 

2195.32 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC  $ 

MCON  $ 

Total  $ 

PROC  Qty 

MSSM 

1057.51 

5827.42 

6.45 

6891.38 

9595 

mmm 

1057.06 

5834.61 

6.24 

6897.91 

9595 

1056.61 

5806.10 

10.40 

6873.12 

9595 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

MSSM 

4147.44 

-572.94 

-728.24 

3567.77 

579.67 

4154.62 

0.00 

mmm 

0.00 

3567.77 

586.85 

4126.12 

0.00 

0.00 

3567.77 

558.35 

Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

■m 

13.92 

0.75 

2264.16 

2846.60 

461.07 

13.92 

0.75 

2264.16 

2846.60 

466.78 

13.92 

0.75 

2264.16 

2846.60 

444.11 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

RDTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

■m 

1.27 

#DIV/0! 

2.05 

1.28 

#DIV/0! 

2.05 

3.46 

1.26 

#DIV/0! 

1.45 
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Appendix  D,  AGM-114  (Hellfire)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PROC  $ 

MCON  $ 

Total  $ 

1976 

24600 

634.67 

874.38 

0.00 

1509.05 

Wmm 

1976 

24600 

634.67 

874.38 

0.00 

1509.05 

1976 

24600 

634.67 

874.38 

0.00 

1509.05 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC  $ 

MCON  $ 

Total  $ 

PROC  Qty 

■m 

824.64 

2122.40 

2947.04 

46175 

832.95 

2097.45 

0.00 

2930.40 

805.16 

2070.74 

2875.89 

45659 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

■m 

1248.02 

-22.89 

-10.86 

277.37 

970.65 

1223.07 

-30.53 

-34.64 

242.73 

980.34 

1196.36 

15.85 

-15.26 

227.47 

968.89 

Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

3.59 

0.75 

1361.08 

1969.98 

670.63 

3.59 

0.75 

1361.08 

1940.57 

687.59 

3.59 

0.75 

1361.08 

1957.02 

673.85 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

RDTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

■m 

1.30 

2.43 

1.77 

#DIV/0! 

1.95 

1.57 

1.31 

2.40 

1.79 

#DIV/0! 

1.94 

1.59 

1.27 

2.37 

1.77 

#DIV/0! 

1.91 

1.56 
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Appendix  E,  AGM-114K  (Hellfire  Longbow)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Learning  Curve  Analysis 


SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

5.83 

0.77 

1833.95 

1833.95 

27.73 

1992 

5.83 

0.77 

1833.95 

2075.79 

772.74 

1993 

5.83 

0.77 

1833.95 

2075.79 

603.09 

1994 

5.83 

0.77 

1833.95 

2075.79 

58.49 

1995 

5.83 

0.77 

1833.95 

2070.87 

134.29 

1996 

5.83 

0.77 

1833.95 

2045.94 

169.97 

1997 

5.83 

0.77 

1833.95 

2036.38 

192.92 

1998 

5.83 

0.77 

1833.95 

2036.38 

198.52 

1999 

5.83 

0.77 

1833.95 

2036.38 

219.23 

2000 

5.83 

0.77 

1833.95 

2036.38 

219.23 

2001 

5.83 

0.77 

1833.95 

2036.38 

274.30 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1991 

1.00 

1.02 

#DIV/0! 

MBM 

1.01 

1992 

1.18 

1.78 

#DIV/0! 

mSSm 

1.44 

1993 

1.18 

1.66 

#DIV/0! 

1.35 

1994 

1.18 

1.26 

1.04 

#DIV/0! 

1.25 

1.06 

1995 

1.37 

1.31 

1.09 

#DIV/0! 

1.32 

1.14 

1996 

1.37 

1.32 

1.11 

#DIV/0! 

1.33 

1.16 

1997 

1.35 

1.32 

1.12 

#DIV/0! 

1.33 

1.17 

1998 

1.29 

1.32 

1.13 

#DIV/0! 

1.32 

1.16 

1999 

1.29 

1.34 

1.14 

#DIV/0! 

1.33 

1.17 

2000 

1.29 

1.34 

1.14 

#DIV/0! 

1.33 

1.17 

2001 

1.35 

1.38 

1.18 

#DIV/0! 

1.37 

1.21 
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Appendix  F.  AIM-9X  (Sidewinder)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC  $ 

MCQN  $ 

Total  $ 

1994 

0 

553.71 

0.00 

553.71 

1995 

0 

553.71 

0.00 

553.71 

1996 

1996 

10000 

553.71 

2014.28 

2567.99 

1997 

1996 

10000 

553.71 

2014.28 

0.00 

2567.99 

1998 

1996 

10000 

553.71 

2014.28 

0.00 

2567.99 

1999 

1996 

10000 

553.71 

2014.28 

0.00 

2567.99 

2000 

1996 

10000 

553.71 

2014.28 

0.00 

2567.99 

2001 

1996 

10000 

553.71 

2014.28 

0.00 

2567.99 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC  $ 

MCON  $ 

Total  $ 

PRQC  Qty 

1994 

658.71 

0.00 

658.71 

0 

1995 

667.62 

0.00 

667.62 

0 

1996 

553.71 

2014.28 

2567.99 

1997 

542.36 

2159.98 

2702.34 

1998 

558.09 

2082.75 

2640.84 

1999 

564.24 

1869.41 

2433.65 

2000 

564.24 

1869.41 

0.00 

2433.65 

2001 

570.59 

1956.12 

0.00 

2526.72 

10097 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

1994 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

1995 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

1996 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

1997 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

1998 

11.78 

11.78 

2.81 

14.59 

14.59 

-2.81 

1999 

2.50 

2.50 

0.73 

3.23 

17.82 

-15.32 

2000 

2.50 

2.50 

0.73 

3.23 

21.05 

-18.55 

2001 

-0.83 

-0.83 

0.00 

0.00 

21.05 

-21.89 
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Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

1994 

0.00 

0.00 

0.00 

0.00 

1995 

0.00 

0.00 

0.00 

0.00 

0.00 

1996 

0.73 

0.90 

1823.02 

1823.02 

0.00 

1997 

0.73 

0.90 

1823.02 

1823.02 

0.00 

1998 

0.73 

0.90 

1823.02 

1835.40 

-2.79 

1999 

0.73 

0.90 

1823.02 

1838.02 

-15.20 

2000 

0.73 

0.90 

1823.02 

1838.02 

-18.40 

2001 

0.73 

0.90 

1823.02 

1838.02 

-21.71 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

RDTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1994 

#DIV/0! 

#DIV/0! 

#DIV/0! 

1.19 

1995 

#DIV/0! 

#DIV/0! 

#DIV/0! 

1.21 

mSm 

1996 

1.00 

1.00 

#DIV/0! 

1.00 

1997 

0.98 

1.07 

1.00 

#DIV/0! 

1.05 

1.00 

1998 

1.01 

1.03 

1.00 

#DIV/0! 

1.03 

1.00 

1999 

1.02 

0.93 

0.99 

#DIV/0! 

0.95 

1.00 

2000 

1.02 

0.93 

0.99 

#DIV/0! 

0.95 

1.00 

2001 

1.03 

0.97 

0.99 

#DIV/0! 

0.98 

1.00 
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Appendix  G.  AIM-54C  (Phoenix)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

SAR 

YEAR 

MSII 

Baseline 

Year 

MSII 

Baseline 

Qty 

MSII 

Baseline 

RDTE$ 

MSII 

Baseline 
PROC  $ 

MSII 

Baseline 
MCON  $ 

MSII 

Baseline 
Total  $ 

1991 

1976 

2885 

901.90 

3800.46 

2.49 

4704.84 

Current  Data 

SAR 

YEAR 

MSII 

Current 

RDTE$ 

MSII 
Current 
PROC  $ 

MSII 
Current 
MCON  $ 

MSII 
Current 
Total  $ 

Current 
PROC  Qty 

1991 

300.76 

3314.29 

2.94 

3617.99 

2483 

Quantity  Variance  Data 

SAR 

YEAR 

Current 

PROC  Var 

Direct  Qty 
Var 

Indirect 
Qty  Var 

Total  Qty 
Var 

Cum  Total 
Qty  Var 

Residual 

Var 

1991 

-486.16 

0.00 

0.00 

0.00 

1621.92 

-2108.08 

Learning  Curve  Analysis 

SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

10.73 

0.84 

4003.52 

3580.99 

-2356.82 

Cost  Growth  Factors 

SAR 

YEAR 

RDTE 

CGF 

UNADJ 

PROC 

CGF 

ADJ 

PROC 

CGF 

MCON 

CGF 

UNADJ 

TOTAL 

CGF 

ADJ 

TOTAL 

CGF 

1991 

0.33 

0.87 

0.38 

1.18 

0.77 

0.37 
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Appendix  H.  AIM-120  (AMRAAM)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 


SAR 

YEAR 

MSN 

Baseline 

Year 

MSN 

Baseline 

Qty 

MSN 

Baseline 

RDTE$ 

MSN 

Baseline 

PROC$ 

MSII 

Baseline 
MCON  $ 

MSII 

Baseline 
Total  $ 

1991 

24335 

1636.22 

9103.01 

0.00 

10739.23 

1992 

24335 

1636.22 

9103.01 

0.00 

10739.23 

1993 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

1994 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

1995 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

1996 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

1997 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

1998 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

1999 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

2000 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

2001 

1982 

24335 

1636.22 

9103.01 

0.00 

10739.23 

SAR 

YEAR 


1991 

1992 

1993 

1994 

1995 

1996 

1997 

1998 

1999 

2000 
2001 


MSN 

Current 

RDTE$ 


1917.68 

2406.35 

2383.18 

2449.49 

2464.10 

2449.95 

2434.77 

2508.62 

2509.53 

2509.53 

2507.13 


MSN 

Current 

PROC$ 


10888.69 

11713.62 

11111.05 

10641.78 

9907.93 

9638.50 

9152.96 

9093.99 

9086.99 
9086.99 
9123.59 


Current  Data 


MSN 
Current 
MCON  $ 


0.00 


MSN 
Current 
Total  $ 


12806.37 

14119.97 

13494.22 

13091.27 

12372.03 

12088.45 

11587.73 

11602.61 

11596.52 

11596.52 

11630.72 


Current 
PROC  Qty 


5450 
3038 
3038 
2018 
1019 
0917 
0917 
10917 
10917 
10917 
10917 


Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PRQC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

1991 

1785.68 

0.00 

12.79 

12.79 

-2646.55 

4432.23 

1992 

2610.62 

-1034.34 

330.55 

-703.80 

-3350.34 

5960.96 

1993 

2008.04 

0.00 

-43.83 

-43.83 

-3394.18 

5402.22 

1994 

1538.77 

-432.33 

-25.64 

-457.98 

-3852.15 

5390.92 

1995 

804.92 

-710.12 

232.38 

-477.75 

-4329.90 

5134.82 

1996 

535.49 

-43.15 

5.08 

-38.07 

-4367.97 

4903.46 

1997 

49.95 

0.00 

0.00 

0.00 

-4367.97 

4417.92 

1998 

-9.02 

0.00 

0.00 

0.00 

-4367.97 

4358.95 

1999 

-16.02 

0.00 

0.00 

0.00 

-4367.97 

4351.95 

2000 

-16.02 

0.00 

0.00 

0.00 

-4367.97 

4351.95 

2001 

20.58 

0.00 

0.00 

0.00 

-4367.97 

4388.55 
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Learning  Curve  Analysis 


SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

71.27 

0.72 

13773.66 

10869.57 

5616.42 

1992 

71.27 

0.72 

13773.66 

9949.24 

8252.32 

1993 

71.27 

0.72 

13773.66 

9949.24 

7478.80 

1994 

71.27 

0.72 

13773.66 

9535.64 

7786.86 

1995 

71.27 

0.72 

13773.66 

9113.92 

7760.14 

1996 

71.27 

0.72 

13773.66 

9069.85 

7446.50 

1997 

71.27 

0.72 

13773.66 

9069.85 

6709.14 

1998 

71.27 

0.72 

13773.66 

9069.85 

6619.59 

1999 

71.27 

0.72 

13773.66 

9069.85 

6608.96 

2000 

71.27 

0.72 

13773.66 

9069.85 

6608.96 

2001 

71.27 

0.72 

13773.66 

9069.85 

6664.54 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1991 

1.17 

1.62 

#DIV/0! 

1.19 

1.55 

1992 

1.47 

1.29 

1.91 

#DIV/0! 

1.31 

1.84 

1993 

1.46 

1.22 

1.82 

#DIV/0! 

1.26 

1.77 

1994 

1.50 

1.17 

1.86 

#DIV/0! 

1.22 

1.80 

1995 

1.51 

1.09 

1.85 

#DIV/0! 

1.15 

1.80 

1996 

1.50 

1.06 

1.82 

#DIV/0! 

1.13 

1.77 

1997 

1.49 

1.01 

1.74 

#DIV/0! 

1.08 

1.70 

1998 

1.53 

1.00 

1.73 

#DIV/0! 

1.08 

1.70 

1999 

1.53 

1.00 

1.73 

#DIV/0! 

1.08 

1.70 

2000 

1.53 

1.00 

1.73 

#DIV/0! 

1.08 

1.70 

2001 

1.53 

1.00 

1.73 

#DIV/0! 

1.08 

1.70 
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Appendix  I.  ATACMS  P3I  (BAT)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Learning  Curve  Analysis 


SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

0.85 

3952.67 

3952.67 

0.00 

1992 

0.85 

3952.67 

2626.75 

0.00 

1993 

1.46 

0.85 

3952.67 

2852.21 

-48.52 

1994 

1.46 

0.85 

3952.67 

2852.85 

178.97 

1995 

1.46 

0.85 

3952.67 

2817.87 

172.44 

1996 

1.46 

0.85 

3952.67 

2814.52 

139.06 

1997 

1.46 

0.85 

3952.67 

2796.00 

328.31 

1998 

1.46 

0.85 

3952.67 

2780.15 

800.32 

1999 

1.46 

0.85 

3952.67 

2351.69 

1741.37 

2000 

1.46 

0.85 

3952.67 

2351.69 

2186.68 

2001 

1.46 

0.85 

3952.67 

2395.26 

2139.08 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

RDTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1991 

1.00 

1.00 

#DIV/0! 

1.00 

1.00 

1992 

1.41 

0.73 

1.00 

#DIV/0! 

0.94 

1.13 

1993 

1.63 

0.78 

0.97 

#DIV/0! 

1.05 

1.18 

1994 

1.67 

0.87 

1.10 

#DIV/0! 

1.12 

1.28 

1995 

1.66 

0.86 

1.10 

#DIV/0! 

1.11 

1.27 

1996 

1.73 

0.84 

1.08 

#DIV/0! 

1.12 

1.28 

1997 

1.79 

0.91 

1.18 

#DIV/0! 

1.19 

1.37 

1998 

1.88 

1.09 

1.45 

#DIV/0! 

1.34 

1.58 

1999 

1.90 

1.21 

1.97 

#DIV/0! 

1.42 

1.95 

2000 

1.90 

1.21 

2.22 

#DIV/0! 

1.42 

2.12 

2001 

2.39 

1.22 

2.19 

#DIV/0! 

1.59 

2.25 

86 


Appendix  J.  BLU-108  JSOW  AIWSACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


87 


Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

1992 

2.31 

0.86 

2754.46 

2754.46 

0.00 

1993 

2.31 

0.86 

2754.46 

2754.46 

44.45 

1994 

2.31 

0.86 

2754.46 

3462.35 

-47.28 

1995 

2.31 

0.86 

2754.46 

4390.14 

-44.29 

1996 

2.31 

0.86 

2754.46 

4390.14 

-73.67 

1997 

2.31 

0.86 

2754.46 

4390.14 

-67.26 

1998 

2.31 

0.86 

2754.46 

4416.65 

-100.06 

1999 

2.31 

0.86 

2754.46 

4414.51 

-76.97 

2000 

2.31 

0.86 

2754.46 

4414.51 

-75.71 

2001 

2.31 

0.86 

2754.46 

4414.51 

372.56 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

RDTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1992 

1.00 

1.00 

1.00 

0.99 

1.00 

1993 

1.07 

0.96 

1.02 

0.53 

0.97 

1994 

1.09 

1.18 

0.97 

0.54 

1.15 

1995 

1.64 

1.95 

0.98 

0.57 

1.88 

1996 

1.66 

1.93 

0.96 

0.00 

1.86 

1.08 

1997 

1.66 

1.93 

0.96 

0.00 

1.86 

1.08 

1998 

1.63 

1.92 

0.95 

0.00 

1.84 

1.06 

1999 

1.65 

1.93 

0.96 

0.00 

1.86 

1.07 

2000 

1.65 

1.93 

0.96 

0.00 

1.86 

1.07 

2001 

1.66 

2.31 

1.20 

0.00 

2.17 

1.27 
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Appendix  K,  BLU-108  JSOW  Unitary  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC  $ 

MCQN  $ 

Total  $ 

1995 

1995 

3848.23 

4163.45 

1996 

1995 

3848.23 

4163.45 

1997 

1995 

7800 

315.22 

3848.23 

4163.45 

1998 

1995 

7800 

315.22 

3848.23 

4163.45 

1999 

1995 

7800 

315.22 

3848.23 

0.00 

4163.45 

2000 

1995 

7800 

315.22 

3848.23 

0.00 

4163.45 

2001 

1995 

7800 

315.22 

3848.23 

0.00 

4163.45 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC  $ 

MCON  $ 

Total  $ 

PRQC  Qty 

1995 

315.22 

3848.23 

4163.45 

1996 

326.77 

3123.96 

3450.73 

:  m 

1997 

337.35 

3113.98 

3451.32 

:  m 

1998 

256.99 

1657.24 

1914.23 

^^B  :  m 

1999 

261.37 

726.88 

988.25 

^^B  1  m 

2000 

261.37 

726.88 

988.25 

2001 

299.54 

765.87 

1065.40 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

1995 

0.00 

0.00 

112.92 

112.92 

1996 

0.00 

0.00 

-488.77 

-488.77 

1997 

0.00 

0.00 

-7.07 

-7.07 

-382.92 

382.92 

1998 

0.00 

0.00 

-1031.30 

-1031.30 

-1414.22 

1414.22 

1999 

-929.40 

0.00 

-0.67 

-0.67 

-1414.89 

485.49 

2000 

-929.40 

0.00 

-0.67 

-0.67 

-1415.56 

486.16 

2001 

0.24 

0.00 

31.80 

31.80 

-1383.76 

1384.00 
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Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

1995 

12.22 

0.77 

3402.94 

3402.94 

1996 

12.22 

0.77 

3402.94 

3402.94 

1997 

12.22 

0.77 

3402.94 

3402.94 

382.92 

1998 

12.22 

0.77 

3402.94 

3402.94 

1414.22 

1999 

12.22 

0.77 

3402.94 

1867.26 

884.77 

2000 

12.22 

0.77 

3402.94 

1867.26 

885.99 

2001 

12.22 

0.77 

3402.94 

1867.26 

2522.24 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1995 

1.00 

1.00 

#DIV/0! 

1.00 

1996 

1.04 

0.81 

#DIV/0! 

0.83 

1997 

1.07 

0.81 

1.10 

#DIV/0! 

0.83 

1.10 

1998 

0.82 

0.43 

1.37 

#DIV/0! 

0.46 

1.33 

1999 

0.83 

0.19 

1.23 

#DIV/0! 

0.24 

1.20 

2000 

0.83 

0.19 

1.23 

#DIV/0! 

0.24 

1.20 

2001 

0.95 

0.20 

1.66 

#DIV/0! 

0.26 

1.60 
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Appendix  L.  CBU-97B  SFW  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC$ 

MCQN  $ 

Total  $ 

14000 

167.25 

2241.25 

0.00 

2408.50 

mmm 

14000 

167.25 

2241.25 

0.00 

2408.50 

1985 

14000 

167.25 

2241.25 

0.00 

2408.50 

1994 

1985 

14000 

167.25 

2241.25 

0.00 

2408.50 

1995 

1985 

14000 

167.25 

2241.25 

0.00 

2408.50 

1996 

1985 

14000 

167.25 

2241.25 

0.00 

2408.50 

1997 

1985 

14000 

167.25 

2241.25 

0.00 

2408.50 

1998 

1985 

14000 

167.25 

2241.25 

0.00 

2408.50 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC$ 

MCQN  $ 

Total  $ 

PRQC  Qty 

266.29 

2125.10 

0.00 

2391.39 

10000 

275.68 

1322.01 

0.00 

1597.69 

5000 

285.69 

1234.95 

0.00 

1520.63 

5000 

1994 

277.31 

1284.99 

0.00 

1562.30 

5000 

1995 

286.50 

1420.26 

0.00 

1706.76 

5000 

1996 

325.71 

1497.56 

0.00 

1823.27 

5000 

1997 

323.05 

1505.90 

0.00 

1828.95 

5000 

1998 

337.55 

1386.49 

0.00 

1724.05 

4837 

Quantity  Variance  Data 

Current 

SAR 

PROC$ 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

Bn 

-116.15 

-531.53 

-4.07 

-203.62 

87.47 

-919.24 

-720.50 

-39.26 

-963.38 

44.14 

-1006.31 

0.00 

0.00 

-963.38 

-42.92 

1994 

-956.27 

0.00 

0.00 

0.00 

-963.38 

7.12 

1995 

-820.99 

0.00 

0.00 

0.00 

-963.38 

142.39 

1996 

-743.69 

0.00 

0.00 

0.00 

-963.38 

219.69 

1997 

-735.35 

0.00 

0.00 

0.00 

-963.38 

228.03 

1998 

-854.76 

-37.84 

-6.92 

-44.75 

-1008.13 

153.37 
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Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

8.33 

0.75 

2167.76 

1781.87 

106.41 

8.33 

0.75 

2167.76 

1189.86 

80.41 

8.33 

0.75 

2167.76 

1189.86 

-78.20 

1994 

8.33 

0.75 

2167.76 

1189.86 

12.97 

1995 

8.33 

0.75 

2167.76 

1189.86 

259.41 

1996 

8.33 

0.75 

2167.76 

1189.86 

400.24 

1997 

8.33 

0.75 

2167.76 

1189.86 

415.44 

1998 

8.33 

0.75 

2167.76 

1167.10 

284.87 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1.59 

0.95 

1.05 

#DIV/0! 

0.99 

1.09 

1.65 

0.59 

1.04 

#DIV/0! 

0.66 

1.08 

1.71 

0.55 

0.97 

#DIV/0! 

0.63 

1994 

1.66 

0.57 

1.01 

#DIV/0! 

0.65 

1.05 

1995 

1.71 

0.63 

1.12 

#DIV/0! 

0.71 

1.16 

1996 

1.95 

0.67 

1.18 

#DIV/0! 

0.76 

1.23 

1997 

1.93 

0.67 

1.19 

#DIV/0! 

0.76 

1.24 

1998 

2.02 

0.62 

1.13 

#DIV/0! 

0.72 

1.19 
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Appendix  M,  FGM-148A  (Javeline)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Learning  Curve  Analysis 


SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

3.18 

0.75 

2269.32 

2269.32 

299.14 

1992 

3.18 

0.75 

2269.32 

2191.43 

1327.35 

1993 

3.18 

0.75 

2269.32 

1466.86 

2866.49 

1994 

3.18 

0.75 

2269.32 

1405.69 

2233.55 

1995 

3.18 

0.75 

2269.32 

1405.82 

2322.74 

1996 

3.18 

0.75 

2269.32 

1343.95 

2598.63 

1997 

3.18 

0.75 

2269.32 

1329.87 

2856.42 

1998 

3.18 

0.75 

2269.32 

1288.24 

3614.26 

1999 

3.18 

0.75 

2269.32 

1153.97 

3904.83 

2000 

3.18 

0.75 

2269.32 

1153.97 

4306.74 

2001 

3.18 

0.75 

2269.32 

1255.26 

4159.15 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

RDTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1991 

1.43 

1.09 

1.09 

#DIV/0! 

1.14 

1992 

1.46 

1.33 

1.39 

#DIV/0! 

1.40 

1993 

1.48 

1.04 

1.83 

#DIV/0! 

1.10 

1.78 

1994 

1.48 

0.81 

1.65 

#DIV/0! 

0.91 

1.62 

1995 

1.48 

0.83 

1.67 

#DIV/0! 

0.92 

1.65 

1996 

1.52 

0.83 

1.76 

#DIV/0! 

0.93 

1.72 

1997 

1.54 

0.88 

1.83 

#DIV/0! 

0.98 

1.79 

1998 

1.55 

0.96 

2.05 

#DIV/0! 

1.05 

1.98 

1999 

1.54 

0.89 

2.13 

#DIV/0! 

0.98 

2.05 

2000 

1.54 

0.89 

2.25 

#DIV/0! 

0.98 

2.15 

2001 

1.55 

0.99 

2.21 

#DIV/0! 

1.07 

2.11 
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Appendix  N,  JDAM  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC$ 

MCQN  $ 

Total  $ 

1995 

1995 

87496 

1724.54 

0.00 

2248.78 

1996 

1995 

87496 

Mi  8181 

1724.54 

0.00 

2248.78 

1997 

1995 

87496 

524.24 

1724.54 

0.00 

2248.78 

1998 

1995 

87496 

524.24 

1724.54 

0.00 

2248.78 

1999 

1995 

87496 

524.24 

1724.54 

0.00 

2248.78 

2000 

1995 

87496 

524.24 

1724.54 

0.00 

2248.78 

2001 

1995 

87496 

524.24 

1724.54 

0.00 

2248.78 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC$ 

MCQN  $ 

Total  $ 

PROC  Qty 

1995 

524.24 

1724.54 

0.00 

2248.78 

87496 

1996 

480.18 

1747.22 

0.00 

2227.40 

87496 

1997 

474.80 

1807.77 

0.00 

2282.56 

87496 

1998 

611.16 

1831.84 

0.00 

2442.99 

87496 

1999 

605.34 

1895.27 

0.00 

2500.61 

87496 

2000 

605.34 

1895.27 

0.00 

2500.61 

87496 

2001 

747.52 

2884.79 

0.00 

3632.31 

136749 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

1995 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

1996 

22.68 

0.00 

0.00 

0.00 

0.00 

22.68 

1997 

83.23 

0.00 

0.00 

0.00 

0.00 

83.23 

1998 

107.30 

0.00 

0.00 

0.00 

0.00 

107.30 

1999 

170.73 

0.00 

0.00 

0.00 

0.00 

170.73 

2000 

170.73 

0.00 

0.00 

0.00 

0.00 

170.73 

2001 

1160.25 

1024.14 

-123.41 

900.73 

900.73 

259.52 
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Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

1995 

0.04 

0.97 

1900.78 

1900.78 

0.00 

1996 

0.04 

0.97 

1900.78 

1900.78 

22.68 

1997 

0.04 

0.97 

1900.78 

1900.78 

83.23 

1998 

0.04 

0.97 

1900.78 

1900.78 

107.30 

1999 

0.04 

0.97 

1900.78 

1900.78 

170.73 

2000 

0.04 

0.97 

1900.78 

1900.78 

170.73 

2001 

0.04 

0.97 

1900.78 

2915.31 

169.20 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1995 

1.00 

1.00 

1.00 

#DIV/0! 

1.00 

1.00 

1996 

0.92 

1.01 

1.01 

#DIV/0! 

0.99 

0.99 

1997 

0.91 

1.05 

#DIV/0! 

1.02 

1.02 

1998 

1.17 

1.06 

#DIV/0! 

1.09 

1.09 

1999 

1.15 

1.10 

1.10 

#DIV/0! 

1.11 

1.11 

2000 

1.15 

1.10 

1.10 

#DIV/0! 

1.11 

1.11 

2001 

1.43 

1.67 

1.10 

#DIV/0! 

1.62 

1.17 
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Appendix  O,  MIM-104  (Patriot)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

SAR 

YEAR 

MSII 

Baseline 

Year 

MSII 

Baseline 

Qty 

MSII 

Baseline 

RDTE$ 

MSII 

Baseline 

PRQC$ 

MSII 

Baseline 
MCQN  $ 

MSII 

Baseline 
Total  $ 

1991 

1992 

1976 

1976 

5063.03 

5063.03 

7607.20 

7607.20 

12697.44 

12697.44 

Current  Data 

SAR 

YEAR 

MSII 

Current 

RDTE$ 

MSN 

Current 

PROC$ 

MSII 

Current 
MCQN  $ 

MSII 

Current 
Total  $ 

Current 
PRQC  Qty 

1991 

1992 

5694.39 

5694.39 

11953.52 

11963.64 

206.34 

206.34 

17854.26 

17864.37 

6475 

6915 

Quantity  Variance  Data 

SAR 

YEAR 

Current 

PROC  Var 

Direct  Qty 
Var 

Indirect 
Qty  Var 

Total  Qty 
Var 

Cum  Total 
Qty  Var 

Residual 

Var 

1991 

1992 

4346.33 

4356.45 

296.48 

0.00 

0.00 

0.00 

296.48 

0.00 

1913.42 

1913.42 

2432.91 

2443.03 

Learning  Curve  Analysis 

SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

1992 

0.76 

0.76 

1134.83 

1134.83 

13295.12 

13842.01 

207.67 

200.29 

Cost  Growth  Factors 

SAR 

YEAR 

RDTE 

CGF 

UNADJ 

PRQC 

CGF 

ADJ 

PRQC 

CGF 

MCQN 

CGF 

UNADJ 

TQTAL 

CGF 

ADJ 

TQTAL 

CGF 

1991 

1992 

1.57 

1.57 

7.58 

7.58 

1.41 

1.41 
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Appendix  P.  MIM-104  (Patriot  PAC-3)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC$ 

MCQN  $ 

Total  $ 

1994 

2403.50 

3316.47 

0.00 

5719.97 

1995 

2403.50 

3316.47 

0.00 

5719.97 

1996 

1994 

1200 

2403.50 

3316.47 

0.00 

5719.97 

1997 

1994 

1200 

2403.50 

3316.47 

0.00 

5719.97 

1998 

1994 

1200 

2403.50 

3316.47 

0.00 

5719.97 

1999 

1994 

1200 

2403.50 

3316.47 

0.00 

5719.97 

2000 

1994 

1200 

2403.50 

3316.47 

0.00 

5719.97 

2001 

1994 

1200 

2403.50 

3316.47 

0.00 

5719.97 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC$ 

MCQN  $ 

Total  $ 

PRQC  Qty 

1994 

2403.50 

3316.47 

0.00 

5719.97 

1200 

1995 

3067.80 

2859.42 

0.00 

5927.22 

1200 

1996 

3128.49 

4083.74 

0.00 

7212.23 

1200 

1997 

3237.10 

4190.54 

0.00 

7427.64 

1200 

1998 

3538.31 

4181.62 

0.00 

7719.93 

560 

1999 

3646.13 

6014.02 

0.00 

9660.15 

1048 

2000 

3646.13 

6014.02 

0.00 

9660.15 

1048 

2001 

3917.59 

7188.89 

0.00 

11106.47 

1199 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

1994 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

1995 

-457.05 

0.00 

0.00 

0.00 

0.00 

-457.05 

1996 

767.27 

0.00 

0.00 

0.00 

0.00 

767.27 

1997 

874.08 

0.00 

0.00 

0.00 

0.00 

874.08 

1998 

865.15 

-917.41 

0.00 

-917.41 

-917.41 

1782.56 

1999 

2697.55 

1370.51 

292.38 

1662.89 

745.48 

1952.08 

2000 

2697.55 

1370.51 

292.38 

1662.89 

2408.36 

289.19 

2001 

3872.42 

376.37 

165.56 

541.93 

2950.29 

922.13 
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Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

1994 

369.48 

0.67 

6998.56 

6998.56 

0.00 

1995 

369.48 

0.67 

6998.56 

6998.56 

-457.05 

1996 

369.48 

0.67 

6998.56 

6998.56 

767.27 

1997 

369.48 

0.67 

6998.56 

6998.56 

874.08 

1998 

369.48 

0.67 

6998.56 

5101.46 

2445.45 

1999 

369.48 

0.67 

6998.56 

6616.18 

2064.90 

2000 

369.48 

0.67 

6998.56 

6616.18 

305.91 

2001 

369.48 

0.67 

6998.56 

6996.14 

922.44 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1994 

1.00 

1.00 

#DIV/0! 

1995 

1.28 

0.86 

0.86 

#DIV/0! 

BEB 

BEfl 

1996 

1.30 

1.23 

1.23 

#DIV/0! 

BB 

BB 

1997 

1.35 

1.26 

1.26 

#DIV/0! 

1998 

1.47 

1.26 

1.74 

#DIV/0! 

1.35 

1.63 

1999 

1.52 

1.81 

1.62 

#DIV/0! 

1.69 

1.58 

2000 

1.52 

1.81 

1.09 

#DIV/0! 

1.69 

1.27 

2001 

1.63 

2.17 

1.28 

#DIV/0! 

1.94 

1.43 
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Appendix  Q.  Navy  Area  TBMD  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSN 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC$ 

MCQN  $ 

Total  $ 

1997 

1997 

mssSM 

2068.85 

3459.43 

0.00 

5528.28 

1998 

1997 

2068.85 

3459.43 

0.00 

5528.28 

1999 

1997 

2068.85 

3459.43 

0.00 

5528.28 

2000 

1997 

2068.85 

3459.43 

0.00 

5528.28 

2001 

1997 

1500 

2068.85 

3459.43 

0.00 

5528.28 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC$ 

MCQN  $ 

Total  $ 

PRQC  Qty 

1997 

2068.85 

3459.43 

0.00 

5528.28 

1998 

2227.30 

3885.80 

0.00 

6113.09 

1999 

2510.16 

3800.20 

0.00 

6310.35 

1500 

2000 

2510.16 

3800.20 

0.00 

6310.35 

1500 

2001 

3170.20 

5021.21 

0.00 

8191.41 

1500 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

1997 

0.00 

0.00 

0.00 

0.00 

0.00 

1998 

426.37 

0.00 

0.00 

0.00 

426.37 

1999 

340.77 

0.00 

0.00 

0.00 

340.77 

2000 

340.77 

0.00 

0.00 

0.00 

340.77 

2001 

1561.78 

0.00 

0.00 

0.00 

1561.78 
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Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

1997 

49.43 

0.75 

3375.54 

3375.54 

0.00 

1998 

49.43 

0.75 

3375.54 

3375.54 

426.37 

1999 

49.43 

0.75 

3375.54 

3375.54 

340.77 

2000 

49.43 

0.75 

3375.54 

3375.54 

340.77 

2001 

49.43 

0.75 

3375.54 

3375.54 

1561.78 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

RDTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1997 

1.00 

#DIV/0! 

1.00 

1.00 

1998 

1.08 

#DIV/0! 

1.11 

1.11 

1999 

1.21 

#DIV/0! 

1.14 

1.14 

2000 

1.21 

1.10 

1.10 

#DIV/0! 

1.14 

1.14 

2001 

1.53 

1.45 

1.45 

#DIV/0! 

1.48 

1.48 
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Appendix  R,  RGM-109  (Tomahawk  MMM)  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC$ 

MCQN  $ 

Total  $ 

■m 

1082 

2944.05 

11480.26 

0.68 

14424.99 

Bel 

1082 

2944.05 

11480.26 

0.68 

14424.99 

IB 

1082 

2944.05 

11480.26 

0.68 

14424.99 

1994 

IB 

1082 

2944.05 

11480.26 

0.68 

14424.99 

1995 

IB 

1082 

2944.05 

11480.26 

0.68 

14424.99 

1996 

mssM 

1082 

2944.05 

11480.26 

0.68 

14424.99 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC$ 

MCQN  $ 

Total  $ 

PRQC  Qty 

■m 

3224.3 

9676.64 

40.89 

12941.82 

4048.00 

3784.3 

10331.70 

74.79 

14190.75 

4568.00 

3933.3 

10271.64 

72.53 

14277.46 

4568.00 

1994 

3288.3 

9855.85 

72.53 

13216.67 

4365.00 

1995 

3281.7 

9776.91 

82.02 

13140.62 

4301.00 

1996 

3283.9 

9874.48 

79.08 

13237.46 

4301.00 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

-1803.63 

218.19 

40.94 

259.13 

8424.12 

-10227.75 

-1148.57 

547.68 

39.96 

587.64 

9011.77 

-10160.33 

-1208.63 

0.00 

0.00 

0.00 

9011.77 

-10220.40 

1994 

-1624.42 

-201.77 

-129.44 

-331.21 

8680.56 

-10304.98 

1995 

-1703.36 

-65.46 

30.40 

-35.06 

8645.50 

-10348.86 

1996 

-1605.79 

0.00 

0.00 

0.00 

8645.50 

-10251.29 
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Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

KM 

3149.20 

8508.49 

-3785.54 

3149.20 

9319.44 

-3433.35 

16.31 

0.84 

3149.20 

9319.44 

-3453.65 

1994 

16.31 

0.84 

3149.20 

9005.71 

-3603.53 

1995 

16.31 

0.84 

3149.20 

8906.07 

-3659.37 

1996 

16.31 

0.84 

3149.20 

8906.07 

-3624.87 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1.10 

0.84 

0.67 

0.76 

1.29 

0.90 

0.70 

BH 

0.83 

1.34 

0.89 

0.70 

107.00 

0.83 

1994 

1.12 

0.86 

0.69 

107.00 

0.92 

0.78 

1995 

1.11 

0.85 

0.68 

121.00 

0.91 

0.78 

1996 

1.12 

0.86 

0.68 

116.67 

0.92 

0.78 
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Appendix  S,  RIM-662/67D  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Learning  Curve  Analysis 


SAR 

YEAR 

T1 

Learn 

Curve 

Theoretic 

Baseline 

Value 

Theoretic 

Current 

Value 

Calc  Qty 
Var 

1991 

13.16 

8501.41 

8983.09 

-920.62 

1992 

13.16 

0.81 

8501.41 

8983.09 

-350.62 

1993 

13.16 

0.81 

8501.41 

8983.09 

-203.26 

1994 

13.16 

0.81 

8501.41 

8983.09 

-318.12 

1995 

13.16 

0.81 

8501.41 

8983.09 

13.91 

1996 

13.16 

0.81 

8501.41 

8983.09 

-218.83 

1997 

13.16 

0.81 

8501.41 

8983.09 

-43.52 

1998 

13.16 

0.81 

8501.41 

8983.09 

79.74 

1999 

13.16 

0.81 

8501.41 

8983.09 

92.00 

2000 

13.16 

0.81 

8501.41 

8983.09 

96.68 

2001 

13.16 

0.81 

8501.41 

8983.09 

479.11 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

1991 

1.71 

1.34 

0.89 

#DIV/0! 

1.38 

0.98 

1992 

1.66 

1.41 

0.96 

#DIV/0! 

1.44 

1.04 

1993 

1.66 

1.43 

0.98 

#DIV/0! 

1.46 

1.05 

1994 

1.67 

1.08 

0.96 

#DIV/0! 

1.14 

1.04 

1995 

1.68 

1.14 

1.00 

#DIV/0! 

1.20 

1.08 

1996 

1.70 

1.11 

0.97 

#DIV/0! 

1.17 

1.05 

1997 

1.70 

1.14 

0.99 

#DIV/0! 

1.20 

1.07 

1998 

1.70 

1.15 

1.01 

#DIV/0! 

1.21 

1.08 

1999 

1.70 

1.15 

1.01 

#DIV/0! 

1.21 

1.09 

2000 

1.70 

1.15 

1.01 

#DIV/0! 

1.21 

1.09 

2001 

1.71 

1.20 

1.06 

#DIV/0! 

1.26 

1.13 
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Appendix  T.  SAD  ARM  155mm  Projectile  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC$ 

MCQN  $ 

Total  $ 

■m 

304.89 

0.00 

605.25 

304.89 

0.00 

605.25 

1988 

10156 

304.89 

0.00 

605.25 

1994 

1988 

10156 

300.35 

304.89 

0.00 

605.25 

1995 

1988 

10156 

300.35 

304.89 

0.00 

605.25 

1996 

1988 

10156 

300.35 

304.89 

0.00 

605.25 

1997 

1988 

10156 

300.35 

304.89 

0.00 

605.25 

1998 

1988 

10156 

300.35 

304.89 

0.00 

605.25 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC$ 

MCQN  $ 

Total  $ 

PRQC  Qty 

286.83 

817.06 

0.00 

1103.90 

39018 

IB 

295.93 

837.47 

0.00 

1133.40 

39018 

IB 

392.34 

732.97 

0.00 

1125.32 

39018 

IB 

401.06 

1820.26 

0.00 

2221.32 

73532 

IB 

462.09 

1835.75 

0.00 

2297.84 

73612 

IB 

461.33 

1878.78 

0.00 

2340.11 

73612 

IB 

450.09 

1660.56 

0.00 

2110.65 

50000 

477.00 

1783.38 

0.00 

2260.38 

50000 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

512.17 

0.00 

0.00 

0.00 

431.77 

IB 

532.58 

0.00 

0.00 

0.00 

431.77 

mSm 

428.08 

0.00 

0.00 

0.00 

431.77 

1994 

1515.37 

408.04 

40.82 

448.86 

880.63 

634.74 

1995 

1530.86 

0.74 

0.49 

1.23 

881.86 

649.00 

1996 

1573.89 

0.00 

0.00 

0.00 

881.86 

692.03 

1997 

1355.67 

-272.93 

-157.24 

-430.17 

451.69 

903.98 

1998 

1478.49 

0.37 

0.00 

0.37 

452.06 

1026.43 
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Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

■m 

0.55 

1707.94 

5520.76 

0.55 

1707.94 

5520.76 

msm 

0.55 

0.91 

1707.94 

5520.76 

-1.14 

1994 

0.55 

0.91 

1707.94 

9591.59 

113.03 

1995 

0.55 

0.91 

1707.94 

9600.69 

115.46 

1996 

0.55 

0.91 

1707.94 

9600.69 

123.11 

1997 

0.55 

0.91 

1707.94 

6853.01 

1998 

0.55 

0.91 

1707.94 

6853.01 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

ROTE 

PROC 

PROC 

MCON 

TOTAL 

TOTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

Bn 

0.95 

2.68 

1.08 

#DIV/0! 

1.82 

1.02 

0.99 

2.75 

1.10 

#DIV/0! 

1.87 

1.04 

1.31 

2.40 

1.00 

#DIV/0! 

1.86 

1.15 

1994 

1.34 

5.97 

1.37 

#DIV/0! 

3.67 

1.35 

1995 

1.54 

6.02 

1.38 

#DIV/0! 

3.80 

1.46 

1996 

1.54 

6.16 

1.40 

#DIV/0! 

3.87 

1.47 

1997 

1.50 

5.45 

1.74 

#DIV/0! 

3.49 

1.62 

1998 

1.59 

5.85 

1.84 

#DIV/0! 

3.73 

1.71 
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Appendix  U.  SAD  ARM  155mm  Rocket  ACGF  Calculations 

(Data  in  CY  2000  Dollars  in  Millions) 


Baseline  Data 

MSII 

MSII 

MSII 

MSII 

MSII 

MSII 

SAR 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

Baseline 

YEAR 

Year 

Qty 

RDTE$ 

PRQC$ 

MCQN  $ 

Total  $ 

■m 

1988 

59110 

749.87 

865.01 

0.00 

1614.88 

1988 

59110 

778.30 

865.01 

0.00 

1643.32 

1988 

59110 

828.99 

0.00 

1694.00 

Current  Data 

MSII 

MSII 

MSII 

MSII 

SAR 

Current 

Current 

Current 

Current 

Current 

YEAR 

RDTE$ 

PROC$ 

MCQN  $ 

Total  $ 

PRQC  Qty 

nn 

719.74 

2156.87 

2876.61 

747.03 

2312.76 

0.00 

3059.79 

795.68 

2137.20 

0.00 

2932.88 

23712 

Quantity  Variance  Data 

SAR 

Current 

Direct  Qty 

Indirect 

Total  Qty 

Cum  Total 

Residual 

YEAR 

PROC  Var 

Var 

Qty  Var 

Var 

Qty  Var 

Var 

nn 

1291.86 

0.00 

0.00 

0.00 

1507.99 

-216.13 

1447.75 

0.00 

0.00 

0.00 

1507.99 

-60.24 

1272.19 

0.00 

0.00 

0.00 

1507.99 

-235.80 

Learning  Curve  Analysis 

Theoretic 

Theoretic 

SAR 

Learn 

Baseline 

Current 

Calc  Qty 

YEAR 

T1 

Curve 

Value 

Value 

Var 

nn 

3.35 

0.78 

3489.54 

1958.50 

-385.09 

3.35 

0.78 

3489.54 

1958.50 

-107.33 

3.35 

0.78 

3489.54 

1958.50 

-420.13 

Cost  Growth  Factors 

UNADJ 

ADJ 

UNADJ 

ADJ 

SAR 

RDTE 

PRQC 

PRQC 

MCQN 

TQTAL 

TQTAL 

YEAR 

CGF 

CGF 

CGF 

CGF 

CGF 

CGF 

2.49 

0.55 

#DIV/0! 

1.78 

2.67 

0.88 

#DIV/0! 

1.86 

BB 

0.96 

2.47 

0.51 

#DIV/0! 

1.73 
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Appendix  V.  Learning  Curve  Calculations 

(Data  in  program’s  BY  Dollars  in  Millions) 


AGM-65D  (Maverick 

Cum 

in  Cum 

y- 

Lot 

Cum  Units 

PROC 

Units 

in 

intercept 

Learn 

Number 

Produced 

Cost 

CAUC 

Produced 

(CUAC) 

Siope  (b) 

(ina) 

T1 

Curve 

1 

ii 

103.40 

5.30 

-0.66 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

213.50 

■El 

7.00 

-1.64 

-0.57 

2.39 

10.86 

0.67 

342.20 

0.11 

8.03 

-2.20 

-0.56 

2.32 

10.19 

0.68 

499.20 

0.09 

8.64 

-2.43 

-0.54 

2.16 

8.70 

0.69 

8517 

664.70 

0.08 

9.05 

-2.55 

-0.51 

2.01 

7.45 

0.70 

6 

11741 

803.70 

0.07 

9.37 

-2.68 

-0.50 

1.91 

6.74 

0.71 

7 

911.90 

0.06 

9.62 

-2.80 

-0.49 

1.85 

6.37 

0.71 

8 

17580 

1003.40 

0.06 

9.77 

-2.86 

-0.48 

1.81 

6.10 

0.72 

9 

19659 

1052.30 

0.05 

9.89 

-2.93 

-0.48 

1.79 

5.97 

0.72 

10 

24914 

1161.80 

0.05 

10.12 

-3.07 

-0.48 

1.78 

5.94 

0.72 

AGM-84A  (Harpoon] 

Cum 

in  Cum 

y- 

Lot 

Cum  Units 

PROC 

Units 

in 

intercept 

Learn 

Number 

Produced 

Cost 

CAUC 

Produced 

(CUAC) 

Siope  (b) 

(ina) 

T1 

Curve 

1 

116.00 

■ES 

5.46 

-0.71 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

205.20 

mm 

6.12 

-0.80 

-0.13 

0.02 

1.02 

0.91 

690 

278.70 

6.54 

-0.91 

-0.18 

0.27 

1.31 

0.88 

930 

344.60 

mm 

6.84 

-0.20 

0.42 

1.53 

0.87 

5 

1170 

408.50 

■g 

7.06 

-0.22 

0.50 

1.65 

0.86 

6 

1410 

491.40 

0.35 

7.25 

-1.05 

-0.21 

0.46 

1.58 

0.86 

7 

1650 

572.90 

0.35 

7.41 

-1.06 

-0.20 

0.39 

1.48 

0.87 

8 

1873 

649.90 

0.35 

7.54 

-1.06 

-0.19 

0.32 

1.37 

0.88 

9 

2188 

744.20 

0.34 

7.69 

-1.08 

-0.18 

0.26 

1.30 

0.88 

10 

2542 

838.20 

0.33 

7.84 

-1.11 

-0.17 

0.23 

1.26 

0.89 

11 

2937 

930.40 

0.32 

7.99 

-1.15 

-0.17 

0.22 

1.25 

0.89 

12 

3033 

968.60 

0.32 

8.02 

-1.14 

-0.17 

0.20 

1.23 

0.89 

13 

3142 

1011.30 

0.32 

8.05 

-1.13 

-0.17 

0.18 

1.20 

0.89 

14 

3261 

1059.20 

0.32 

8.09 

-1.12 

-0.16 

0.16 

1.17 

0.89 

15 

3386 

1117.80 

0.33 

8.13 

-1.11 

-0.16 

0.13 

1.13 

0.90 

16 

3553 

1191.60 

0.34 

8.18 

-1.09 

-0.15 

0.09 

1.09 

0.90 
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Cum 

Lot  Cum  Units  PROC 
Number  Produced  Cost 


187.40 

289.50 

434.40 
539.70 
656.80 

745.50 
876.00 

1005.60 

1223.20 

1321.40 


AGM-88  (HARM  USN) 


In  Cum 
Units  In 
Produced  (CUAC) 


4.38 

5.29 
5.88 
6.52 
7.31 
7.72 
8.09 

8.30 
8.58 
8.79 
9.09 
9.17 


Slope  (b) 

y- 

intercept 

(Ina) 

T1 

Learn 

Curve 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

-0.31 

1.30 

3.68 

0.81 

-0.38 

1.62 

5.08 

0.77 

-0.38 

1.60 

4.93 

0.77 

-0.40 

1.72 

5.56 

0.76 

-0.41 

1.78 

5.95 

0.75 

-0.42 

1.83 

6.22 

0.75 

-0.42 

1.85 

6.33 

0.75 

-0.43 

1.86 

6.41 

0.74 

-0.43 

1.86 

6.41 

0.74 

-0.42 

1.85 

6.33 

0.75 

-0.42 

1.83 

6.20 

0.75 

AGM-114(Hellfire) 


Cum 

Lot  Cum  Units  PROC 
Number  Produced  Cost  CAUC 


680  60.40  0.09 

4651  163.60  0.04 

9302  251.70  0.03 

15082  338.50  0.02 

21082  412.10  0.02 

21082  412.10  0.02 

27082  480.80  0.02 

33082  549.20  0.02 

35386  574.90  0.02 

41071  633.40  0.02 

41166  637.00  0.02 

43412  663.20  0.02 

44829  682.50  0.02 

45659  705.50  0.02 


In  Cum 
Units 
Produced 


In 

(CUAC) 


-2.42 

-3.35 

-3.61 

-3.80 

-3.93 

-3.93 

-4.03 

-4.10 

-4.12 

-4.17 

-4.17 

-4.18 

-4.18 

-4.17 


AGM 

-114K  (Hellfire  Longbow) 

Lot 

Number 

Cum  Units 

Produced 

Cum 

PROC 

Cost 

CAUC 

In  Cum 

Units 

Produced 

In 

(CUAC) 

Slope  (b) 

y- 

intercept 

(Ina) 

T1 

Learn 

Curve 

352 

1408 

2508 

4508 

6708 

8908 

11108 

12905 


219.10 

460.60 

682.60 
1007.10 

1279.50 
1537.70 

1747.50 

2030.50 


#NUM! 

-0.46 


#NUM! 

2.25 

2.03 

1.87 

1.82 

1.78 

1.77 

1.71 


#NUM! 

9.46 

7.62 

6.51 

6.16 

5.92 

5.84 

5.53 


#NUM! 

0.72 

0.74 

0.76 

0.76 

0.76 

0.76 

0.77 


no 


Ill 


AIM-120  (AMRAAM) 


Lot 

Number 


1 


Cum  Units 

Produced 

Cum 

PROC 

Cost 

CAUC 

In  Cum 

Units 

Produced 

In 

(CUAC) 

Slope  (b) 

y- 

intercept 

(Ina) 

T1 

Learn 

Curve 

180 

1006.40 

5.19 

1.72 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

580 

1760.30 

6.36 

1.11 

-0.52 

4.43 

84.16 

0.70 

1480 

2589.90 

1.75 

7.30 

-0.55 

4.59 

98.32 

0.68 

2368 

3355.00 

1.42 

7.77 

-0.54 

4.53 

92.80 

0.69 

3268 

4201.00 

1.29 

8.09 

0.25 

-0.52 

4.42 

82.81 

0.70 

4159 

4893.20 

1.18 

8.33 

0.16 

-0.51 

4.33 

75.81 

0.70 

5324 

5548.30 

1.04 

8.58 

0.04 

-0.50 

4.28 

71.92 

0.71 

6382 

6011.50 

0.94 

8.76 

-0.06 

-0.49 

4.25 

70.25 

0.71 

6900 

6289.80 

0.91 

8.84 

-0.09 

-0.49 

4.23 

68.98 

0.71 

7306 

6517.70 

0.89 

8.90 

-0.11 

-0.49 

4.22 

67.91 

0.71 

7539 

6664.40 

0.88 

8.93 

-0.12 

-0.49 

4.20 

66.97 

0.71 

7832 

6802.80 

0.87 

8.97 

-0.14 

-0.49 

4.19 

66.25 

0.71 

8112 

6925.60 

0.85 

9.00 

-0.16 

-0.48 

4.19 

65.70 

0.71 

8366 

7036.50 

0.84 

9.03 

-0.17 

-0.48 

4.18 

65.26 

0.72 

8599 

7148.80 

0.83 

9.06 

-0.18 

-0.48 

4.17 

64.87 

0.72 

8846 

7265.80 

0.82 

9.09 

-0.20 

-0.48 

4.17 

64.51 

0.72 

9107 

7381.00 

0.81 

9.12 

-0.21 

-0.48 

4.16 

64.19 

0.72 

9374 

7498.00 

0.80 

9.15 

-0.22 

-0.48 

4.16 

63.91 

0.72 

9638 

7614.00 

0.79 

9.17 

-0.24 

-0.48 

4.15 

63.65 

0.72 

9900 

7726.00 

0.78 

9.20 

-0.25 

-0.48 

4.15 

63.40 

0.72 

10161 

7834.00 

0.77 

9.23 

-0.26 

-0.48 

4.15 

63.18 

0.72 

10917 

8075.50 

0.74 

9.30 

-0.30 

-0.48 

4.14 

63.08 

0.72 

ATACMS  P3I  (BAT) 


Cum  Units 

Produced 

Cum 

PROC 

Cost 

CAUC 

In  Cum 

Units 

Produced 

304 

88.80 

0.29 

5.72 

913 

204.60 

0.22 

6.82 

1418 

302.50 

0.21 

7.26 

1501 

326.40 

0.22 

7.31 

1501 

346.10 

0.23 

7.31 

1803 

450.80 

0.25 

7.50 

2272 

564.60 

0.25 

7.73 

3217 

696.50 

0.22 

8.08 

4269 

828.40 

0.19 

8.36 

6117 

1018.80 

0.17 

8.72 

8171 

1217.90 

0.15 

9.01 

10226 

1405.90 

0.14 

9.23 

12189 

1579.10 

0.13 

9.41 

14139 

1739.50 

0.12 

9.56 

16089 

1901.10 

0.12 

9.69 

In 

(CUAC) 


.23 
.50 
-1.54 
-1.53 
-1.47 
-1.39 
-1.39 
-1.53 
-1.64 
-1.79 
-1.90 
-1.98 


Slope  (b) 


y- 

intercept 

(Ina) 


.20 
.15 
.03 
-0.13 
-0.25 
-0.50 
-0.73 
-0.74 
-0.62 
-0.39 
-0.19 
-0.03 
0.08 
0.17 
0.24 


Learn 

Curve 


.84 
.85 
.86 
0.87 
0.89 
0.91 
0.93 
0.93 
0.92 
0.90 
0.88 
0.87 
0.86 
0.85 
0.85 
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BLU-108  JSOW  AlWS 


Lot 

Number 


1 


Cum  Units 
Produced 


100 

280 

694 

1222 

1251 

1286 

1687 

2444 

3448 

4347 

5120 

6649 

8074 

9319 

10546 

11540 

12590 

13640 

14690 

15740 

16114 


Cum 

PROC 

Cost 


75.30 

154.80 

277.80 
390.00 
537.30 
559.20 
681.10 
887.90 

1150.60 
1397.00 

1622.70 

1938.80 

2241.20 

2504.60 

2724.80 
2853.40 
3004.50 

3170.20 

3333.60 
3497.30 

3567.70 


In  Cum 
Units 
Produced 


4.61 

5.63 

6.54 
7.11 

7.13 
7.16 

7.43 

7.80 
8.15 
8.38 

8.54 

8.80 
9.00 

9.14 
9.26 

9.35 

9.44 
9.52 
9.59 
9.66 
9.69 


In 

(CUAC) 


BLU-108  JSOW  Unitary 


Lot 

Number 


1 


Cum  Units 
Produced 


75 

175 

325 

575 

825 

1075 

1325 

1575 

2035 

2550 

3000 

4425 

5670 

6897 

7891 

8941 

9991 

11041 

12091 

12465 


Cum 

PROC 

Cost 


154.80 

277.80 
390.00 
537.30 
559.20 
681.10 
887.90 

1150.60 
1397.00 

1622.70 

1938.80 

2241.20 

2504.60 

2724.80 
2853.40 
3004.50 

3170.20 

3333.60 
3497.30 

3567.70 


CAUC 


2.06 

1.59 

1.20 

0.93 

0.68 

0.63 

0.67 

0.73 

0.69 

0.64 

0.65 

0.51 

0.44 

0.40 

0.36 

0.34 

0.32 

0.30 

0.29 

0.29 


In  Cum 
Units 
Produced 


4.32 

5.16 

5.78 

6.35 
6.72 
6.98 
7.19 

7.36 
7.62 

7.84 
8.01 

8.40 
8.64 

8.84 
8.97 
9.10 
9.21 
9.31 

9.40 
9.43 


In 

(CUAC) 


.72 
.46 
0.18 
-0.07 
-0.39 
-0.46 
-0.40 
-0.31 
-0.38 
-0.45 
-0.44 
-0.68 
-0.82 
-0.93 
-1.02 
-1.09 
-1.15 
-1.20 
-1.24 
-1.25 


y- 

intercept 

Learn 

Slope  (b) 

(Ina) 

T1 

Curve 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

-0.30 

1.10 

3.00 

0.81 

-0.33 

1.22 

3.40 

0.80 

-0.34 

1.31 

3.70 

0.79 

-0.29 

1.02 

2.76 

0.82 

-0.26 

0.87 

2.38 

0.84 

-0.24 

0.76 

2.14 

0.85 

-0.23 

0.69 

2.00 

0.86 

-0.22 

0.65 

1.92 

0.86 

-0.21 

0.62 

1.85 

0.86 

-0.21 

0.58 

1.79 

0.87 

-0.21 

0.57 

1.77 

0.87 

-0.21 

0.57 

1.77 

0.87 

-0.21 

0.57 

1.77 

0.87 

-0.21 

0.58 

1.78 

0.87 

-0.21 

0.59 

1.81 

0.87 

-0.21 

0.61 

1.84 

0.86 

-0.21 

0.62 

1.87 

0.86 

-0.22 

0.64 

1.90 

0.86 

-0.22 

0.66 

1.93 

0.86 

-0.22 

0.67 

1.95 

0.86 

ry 

y- 

intercept 

Learn 

Slope  (b) 

(Ina) 

T1 

Curve 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

-0.31 

2.06 

7.86 

0.81 

-0.37 

2.32 

10.18 

0.78 

-0.39 

2.44 

11.49 

0.76 

-0.45 

-0.46 

2.73 

2.78 

0.73 

0.73 

-0.44 

2.67 

14.47 

0.74 

-0.40 

2.49 

12.04 

0.76 

-0.38 

2.34 

10.35 

0.77 

-0.36 

2.23 

9.31 

0.78 

-0.34 

2.12 

8.31 

0.79 

-0.33 

2.09 

8.11 

0.79 

-0.34 

2.10 

8.20 

0.79 

-0.34 

2.13 

8.44 

0.79 

-0.35 

2.17 

8.78 

0.79 

-0.35 

2.21 

9.13 

0.78 

-0.36 

2.25 

9.47 

0.78 

-0.36 

2.28 

9.78 

0.78 

-0.37 

2.31 

10.06 

0.77 

-0.37 

2.33 

10.28 

0.77 
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CBU-97B  SFW 


Lot  Cum  Units 
Number  Produced 


Cum 

PROC 

Cost 


112.00 

159.80 

229.70 

293.70 

356.70 
409.00 

434.20 

475.20 

509.90 

543.90 

576.90 

608.40 

644.40 
681.60 


CAUC 

in  Cum 

Units 

Produced 

in 

(CUAC) 

Siope  (b) 

y- 

intercept 

(ina) 

T1 

Learn 

Curve 

0.58 

4.58 

-0.55 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

0.54 

4.79 

-0.61 

-0.29 

0.80 

2.22 

0.82 

0.45 

5.53 

-0.81 

-0.27 

0.70 

2.01 

0.83 

0.30 

6.26 

-1.19 

-0.37 

1.18 

3.26 

0.77 

0.22 

6.95 

-1.51 

-0.41 

1.36 

3.91 

0.75 

0.19 

7.37 

-1.69 

-0.42 

1.41 

4.10 

0.75 

0.17 

7.67 

-1.79 

-0.42 

1.41 

4.09 

0.75 

0.16 

7.84 

-1.82 

-0.41 

1.38 

3.99 

0.75 

0.16 

7.91 

-1.84 

-0.41 

1.36 

3.90 

0.75 

0.16 

8.02 

-1.85 

-0.40 

1.33 

3.79 

0.76 

0.15 

8.11 

-1.88 

-0.40 

1.31 

3.70 

0.76 

0.15 

8.20 

-1.90 

-0.39 

1.28 

3.61 

0.76 

0.15 

8.28 

-1.92 

-0.39 

1.26 

3.54 

0.76 

0.14 

8.35 

-1.94 

-0.39 

1.24 

3.47 

0.76 

0.14 

8.42 

-1.95 

-0.38 

1.22 

3.40 

0.77 

0.14 

8.48 

-1.96 

-0.38 

1.20 

3.33 

0.77 

FGM-148A  Javeline  AAWS 


Cum 

Lot  Cum  Units  PROC 
Number  Produced  Cost 


703  65.30 

1575  112.00 

2585  159.80 

3746  229.70 

5020  293.70 

9330  356.70 

12708  409.00 

15789  434.20 

19928  475.20 

21653  509.90 

23021  543.90 

24472  576.90 

24472  608.40 

25794  681.60 


in  Cum 
Units 
Produced 


6.56 

7.36 

7.86 

8.23 

8.52 

9.14 

9.45 

9.67 

9.90 

9.98 

10.04 

10.11 

10.11 

10.16 


in 

(CUAC) 


-2.38 

-2.64 

-2.78 

-2.79 

-2.84 

-3.26 

-3.44 

-3.59 

-3.74 

-3.75 

-3.75 

-3.75 

-3.69 

-3.63 


Siope  (b) 


y- 

intercept 

(ina) 

T1 

Learn 

Curve 

-2.38 

-0.21 

-0.32 

-0.69 

0.50 

0.83 

-0.87 

0.42 

0.85 

-0.36 

0.70 

0.81 

-0.05 

0.95 

0.79 

0.19 

1.21 

0.77 

0.38 

1.46 

0.76 

0.47 

1.60 

0.75 

0.51 

1.66 

0.75 

0.52 

1.68 

0.75 

0.50 

1.65 

0.75 

0.45 

1.56 

0.75 
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Lot  Cum  Units 
Number  Produced 


937 

3312 

7835 

17476 

28705 

38792 

66589 

85086 

103731 

123045 

135971 


Cum 

PROC 


184.70 


830.20 

1344.00 

1687.20 

2050.60 

2430.90 

2696.70 


In  Cum 
Units 


y- 

intercept 


tuc 

Produced 

o 

< 

O 

Slope  (b) 

(Ina) 

T1 

Curve 

0.02 

6.84 

-3.76 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

0.02 

8.11 

-3.75 

0.01 

-3.84 

0.02 

1.01 

0.02 

8.97 

-3.75 

0.01 

-3.80 

0.02 

1.00 

0.02 

9.77 

-3.80 

-0.01 

-3.66 

0.03 

0.99 

0.02 

10.26 

-3.82 

-0.02 

-3.62 

0.03 

0.99 

0.02 

10.57 

-3.84 

-0.02 

-3.57 

0.03 

0.98 

0.02 

11.11 

-3.90 

-0.03 

-3.50 

0.03 

0.98 

0.02 

11.35 

-3.92 

-0.04 

-3.46 

0.03 

0.97 

0.02 

11.55 

-3.92 

-0.04 

-3.43 

0.03 

0.97 

0.02 

11.72 

-3.92 

-0.04 

-3.42 

0.03 

0.97 

0.02 

11.82 

-3.92 

-0.04 

-3.42 

0.03 

0.97 

MIM-104  Patriot 


In 

(CUAC) 


Cum  Units 

Produced 

Cum 

PROC 

Cost 

CAUC 

In  Cum 

Units 

Produced 

117 

241.50 

2.06 

4.76 

247 

456.40 

1.85 

5.51 

423 

740.50 

1.75 

6.05 

710 

1042.10 

1.47 

6.57 

1150 

1357.00 

1.18 

7.05 

1590 

1683.30 

1.06 

7.37 

2150 

1975.80 

0.92 

7.67 

2850 

2262.20 

0.79 

7.96 

3565 

2526.80 

0.71 

8.18 

4380 

2762.30 

0.63 

8.38 

5340 

2942.60 

0.55 

8.58 

6475 

3135.90 

0.48 

8.78 

6915 

3191.90 

0.46 

8.84 

Slope  (b) 

y- 

intercept 

(Ina) 

T1 

Learn 

Curve 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

-0.15 

1.43 

4.18 

0.90 

-0.13 

1.34 

3.81 

0.91 

-0.18 

1.59 

4.91 

0.88 

-0.23 

1.89 

6.64 

0.85 

-0.26 

2.04 

7.66 

0.83 

-0.28 

2.17 

8.74 

0.82 

-0.31 

2.30 

9.94 

0.81 

-0.32 

2.40 

11.06 

0.80 

-0.34 

2.50 

12.21 

0.79 

-0.36 

2.61 

13.56 

0.78 

-0.37 

2.71 

15.06 

0.77 

-0.39 

2.79 

16.33 

0.76 

MIM-104  Patriot  PAC3 


Cum 

Lot  Cum  Units  PROC 
Number  Produced  Cost 


6  616.50 

12  845.90 

18  1035.80 

44  1285.20 

50  1443.70 

88  1760.00 

132  2038.90 
204  2581.90 
276  3010.00 
348  3467.30 
479  3849.60 
623  4211.10 
767  4573.20 
911  4889.50 

1055  5195.90 
1199  5640.40 


CAUC 

In  Cum 

Units 

Produced 

In 

(CUAC) 

Slope  (b) 

y- 

intercept 

(Ina) 

T1 

Learn 

Curve 

102.75 

1.79 

4.63 

-2.53 

0.08 

70.49 

2.48 

4.26 

5.61 

272.14 

57.54 

2.89 

4.05 

5.58 

264.60 

29.21 

3.78 

3.37 

5.80 

331.77 

0.65 

28.87 

3.91 

3.36 

-0.62 

5.79 

326.33 

0.65 

20.00 

4.48 

3.00 

-0.62 

5.79 

326.79 

0.65 

15.45 

4.88 

2.74 

-0.62 

5.79 

327.92 

0.65 

12.66 

5.32 

2.54 

-0.61 

5.76 

317.90 

0.65 

10.91 

5.62 

2.39 

-0.60 

5.73 

308.52 

0.66 

9.96 

5.85 

2.30 

-0.59 

5.70 

298.51 

0.66 

8.04 

6.17 

2.08 

-0.59 

5.68 

294.22 

0.66 

6.76 

6.43 

1.91 

-0.59 

5.68 

292.79 

0.67 

5.96 

6.64 

1.79 

-0.59 

5.68 

292.04 

0.67 

5.37 

6.81 

1.68 

-0.59 

5.68 

291.76 

0.67 

4.93 

6.96 

1.59 

-0.59 

5.68 

291.55 

0.67 

4.70 

7.09 

1.55 

-0.59 

5.67 

289.90 

0.67 
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Navy  Area  TBMD 


Cum  Units 

Produced 

Cum 

PROC 

Cost 

CAUC 

In  Cum 

Units 

Produced 

11 

219.20 

19.93 

2.40 

22 

282.30 

12.83 

3.09 

50 

386.90 

7.74 

3.91 

108 

595.20 

5.51 

4.68 

228 

919.60 

4.03 

5.43 

386 

1300.30 

3.37 

5.96 

595 

1752.70 

2.95 

6.39 

822 

2212.90 

2.69 

6.71 

1052 

2682.80 

2.55 

6.96 

1293 

3108.50 

2.40 

7.16 

1500 

3483.90 

2.32 

7.31 

Slope  (b) 

y- 

intercept 

(Ina) 

T1 

Learn 

Curve 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

-0.64 

4.51 

91.36 

0.64 

-0.62 

4.49 

88.85 

0.65 

-0.57 

4.32 

75.45 

0.67 

-0.53 

4.20 

66.53 

0.69 

-0.50 

4.10 

60.37 

0.71 

-0.48 

4.02 

55.73 

0.72 

-0.46 

3.96 

52.22 

0.73 

-0.44 

3.90 

49.34 

0.74 

-0.43 

3.85 

47.18 

0.74 

-0.42 

3.82 

45.45 

0.75 

RGM-109  Tomahawk  MMM 


Lot  Cum  Units 
Number  Produced 


Cum 

PROC 

Cost 


22.50 

122.60 

241.60 
352.80 
520.40 

786.60 
1102.50 

1426.20 

1787.20 
2068.00 
2305.90 

2720.30 
2881.80 

3039.20 

3128.60 
3223.70 

3264.60 

3302.30 

3335.30 


CAUC 


3.75 

2.19 

2.06 

2.10 

1.78 

1.67 

1.53 

1.36 

1.18 

1.02 

0.95 

0.88 

0.88 

0.87 

0.85 

0.81 

0.80 

0.79 

0.78 


In  Cum 
Units 
Produced 


1.79 
4.03 
4.76 
5.12 
5.68 
6.16 
6.58 
6.95 

7.33 
7.62 

7.80 
8.04 
8.10 
8.16 
8.22 
8.29 
8.31 

8.34 
8.37 


In 

(CUAC) 


Slope  (b) 


y- 

intercept 

(Ina) 


T1 

Learn 

Curve 

0.63 

2.00 

5.77 

0.85 

5.39 

0.86 

5.07 

0.88 

5.05 

0.88 

4.99 

0.88 

4.97 

0.88 

5.05 

0.88 

5.24 

0.87 

5.51 

0.87 

5.75 

0.86 

5.97 

0.86 

6.11 

0.85 

6.21 

0.85 

6.30 

0.85 

6.40 

0.85 

6.49 

0.85 

6.58 

0.84 

6.65 

0.84 
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SADARM  155mm  Projectile 

Cum 

In  Cum 

y- 

Lot 

Cum  Units 

PROC 

Units 

In 

intercept 

Learn 

Number 

Produced 

Cost 

CAUC 

Produced 

(CUAC) 

Slope  (b) 

(Ina) 

T1 

Curve 

1 

110 

24.50 

0.22 

4.70 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

233 

60.90 

0.26 

5.45 

mSM 

0.21 

-2.50 

0.08 

1.16 

833 

135.70 

0.16 

6.73 

-1.81 

-0.18 

-0.55 

0.57 

0.88 

1033 

187.40 

0.18 

6.94 

-1.71 

-0.15 

-0.67 

0.51 

0.90 

1063 

212.00 

0.20 

6.97 

-1.61 

-0.13 

-0.81 

0.45 

0.91 

1  SADARM  155mm  Rocket  | 

Cum 

In  Cum 

y- 

Lot 

Cum  Units 

PROC 

Units 

In 

intercept 

Learn 

Number 

Produced 

Cost 

CAUC 

Produced 

(CUAC) 

Slope  (b) 

(Ina) 

T1 

Curve 

1 

246 

84.80 

0.34 

5.51 

-1.07 

#NUM! 

#NUM! 

#NUM! 

#NUM! 

594 

164.70 

0.28 

6.39 

-1.28 

-0.25 

0.29 

1.34 

0.84 

1086 

255.30 

0.24 

6.99 

-1.45 

-0.26 

0.35 

1.42 

0.84 

2886 

395.70 

0.14 

7.97 

-1.99 

-0.37 

1.04 

2.84 

0.77 

4986 

545.30 

0.11 

8.51 

-2.21 

-0.40 

1.20 

3.31 

0.76 

6 

7326 

704.40 

0.10 

8.90 

-2.34 

-0.40 

1.22 

3.39 

0.76 

7 

9786 

866.10 

0.09 

9.19 

-2.42 

-0.40 

1.20 

3.33 

0.76 

8 

13086 

1073.30 

0.08 

9.48 

-2.50 

-0.39 

1.16 

3.20 

0.76 

9 

17112 

1317.00 

0.08 

9.75 

-2.56 

-0.38 

1.11 

3.04 

0.77 

10 

21018 

1550.50 

0.07 

9.95 

-2.61 

-0.38 

1.06 

2.88 

0.77 

11 

23712 

1738.40 

0.07 

10.07 

-2.61 

-0.37 

1.00 

2.73 

0.78 
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